4 ms·
> LLMs aren't the golden bullet the article hints at. Sure they are improving, but the cost is not falling. It costs a huge amount to create foundation models,
by beernet 2y ago
> LLMs aren't the golden bullet the article hints at. Sure they are improving, but the cost is not falling. It costs a huge amount to create foundation models, and there will be a point where either we have a breakthrough (ie we move from sequence generation to concept synthesis) or the money runs out.
Very, very few use cases require training a new model. The vast majority can be solved by inferencing existing models, where it is absolutely true that inference costs are steadily declining.
> making an amazon clone is simple now
Seriously? Cloning Amazon is not equivalent to cloning a frontend...
- mnky9800n 2y agoImo making it easy to specialise a model is hard right now. Building RAGs and other things like that requires technical knowledge but dumping things on ChatGPT does not. Perhaps building a ui for dummies for specialising models so that they actually learn from new data and not just do inference is the way to go. But I imagine perplexity et al. Is already trying to do this.
- KaiserPro 2y ago> Seriously? Cloning Amazon is not equivalent to cloning a frontend... A frontend isn't a business, something that a good number of startups forget. What I mean is that card payment, shipping, inventory management and sourcing are trivial compared to when amazon started.