3 ms·
counterpoint: thinking models are good since they give similar quality at smaller RAM sizes. if a 16b thinking model is as good as a 60b one shot model, you can
by adgjlsfhk1 2y ago
counterpoint: thinking models are good since they give similar quality at smaller RAM sizes. if a 16b thinking model is as good as a 60b one shot model, you can use more compute without as much RAM bottleneck
- terribleperson 2y agoCounter-counterpoint: RAM costs are coming down fast this year. Compute, not so much. I still agree, though.