6 ms·
The churn is an issue. For a while there, it felt like we were getting a new number format every month or two (e.g., fp4, ternary, etc.). That level of innovati
by drob518 3mo ago
The churn is an issue. For a while there, it felt like we were getting a new number format every month or two (e.g., fp4, ternary, etc.). That level of innovation works against moving things into hardware, or at least you need to be willing to spin hardware constantly.
- tracker1 3mo agoEven then... Do we now stop the with to asic DeepSeek and do k3 instead? Assuming such work was happening.
- drob518 3mo agoMy personal feeling is to not move to ASICs just yet. Things are still pretty frothy right now, so I would probably wait 6-12 months. At some point the froth always calms down. At that point, commit to ASICs. That said, I’m also not totally sure exactly how much the ASIC hard codes vs having some wiggle room. The Taalas site is a bit vague as to exactly how they encode the model.
- tracker1 3mo agoI would probably wait until a year goes by without any significant advancement, at the very least before making such an effort.