2 ms·
Cost is also important. LLMs are expensive to run. I think that going forward, we'll see a mix of "normal" programming, LLMs, and simpler machine learning tech
by npsomaratna 3y ago
Cost is also important. LLMs are expensive to run.
I think that going forward, we'll see a mix of "normal" programming, LLMs, and simpler machine learning techniques all combined together, because of economic reasons.
- kqr 3y agoHm. I'm not sure about cost. I haven't done any sort of analysis but I would guess with 75 % certainty that the techniques we use need more watts per byte of data than modern techniques. Modern techniques are very efficient in terms of their operation -- it's just that they achieve performance by needing to do so much operation!
- bmitc 3y agoI was assuming they were referring to the data collection, storage, and processing and model training.