4 ms·
Experts who know what they are doing have long had alternatives beyond LLMs to make their work faster. They have open source libraries, stack overflow, tutoria
by deadbabe 2y ago
Experts who know what they are doing have long had alternatives beyond LLMs to make their work faster.
They have open source libraries, stack overflow, tutorials, documentation, simple code generator tools and snippets.
The speed up we’re seeing is from LLMs basically caching all those things into a huge mathematical model and retrieving information in summarized form ready for consumption.
And while speed is always nice, LLMs are expensive, require maintenance themselves to maintain relevant context, are still error prone, and terrible at true innovation.
In a few years we’ll be talking about the big “AI crash” and “what went wrong” when it has been obvious to experts all along. Winter is coming.
- sega_sai 2y agoI am sorry, but the comparison of 'stack overflow' and tutorials to LLMs is bizarre. The amount of time to get to the answer from LLMs is drastically shorter. And claiming that the they only 'cache thing' is just wrong. They are certainly capable of correctly answering things that were not directly in their training set.
- deadbabe 2y agoDo you have any examples of a question you could ask to an AI right now that you couldn’t find from a basic search on stack overflow and Google? Didn’t think so.