2 ms·
They probably shrunk the model from 175B to 17B. That's your 10:1 price reduction.
by visarga 4y ago
They probably shrunk the model from 175B to 17B. That's your 10:1 price reduction.
- sebzim4500 4y agoWouldn't that almost certainly lead to measurable loss of capabilities?
- CuriouslyC 4y agoIf the model was quantized/distilled correctly, not for a large swath of use cases/problem domain. For anything where loss was not measured during distillation, very likely.