3 ms·
Cost. Same reason you don't deliver UPS packages with B-2 bombers.
by titzer 2y ago
Cost. Same reason you don't deliver UPS packages with B-2 bombers.
- msp26 2y agoThe cost of LLM inference is cheap and will continue to decrease. More traditional methods take up far more of an engineer's time (which also costs money). If I have a project with a low enough lifetime inputs I'm not wasting my time labelling data and training a model. That time could be better spent working on something else. As long as the evaluation is thorough, it doesn't matter. But I still like doing some labelling manually to get a feel for the problem space.