2 ms·The demand is being driven by inference though. I really don't think there will be much motivation.by russdill 6mo agoThe demand is being driven by inference though. I really don't think there will be much motivation.sunir 6mo agoThe large models are incredibly inefficient. We'll be squeezing them down for generations.russdill 6mo agoRight, that's where the major push is right now. Not with shrinking down some code libraries.