5 ms·
I've seen that claim made but I've not seen it in reality. There are examples of where LLMs are useful for information retrieval in that they can take vague qu
by jordanb 2y ago
I've seen that claim made but I've not seen it in reality.
There are examples of where LLMs are useful for information retrieval in that they can take vague queries and produce good summaries, but they're just as likely to produce reasonable-sounding nonsense that needs to be carefully verified.
I've also seen examples where LLMs can produce code that implements well-defined toy problems but when used on a real software system with millions of lines of context they do not produce code that can remain coherent with the system.
From what I've seen LLMs have yet to graduate from "impressive demo" and everyone characterizing them as being a revolution are still describing some potential future state with no real evidence that we'll get there with this technology or any time soon.
- ianbutler 2y agoWe live in different realities then. I can't talk about details for my previous employer, but I can say there is an implementation involving LLMs saving Data Scientists a lot of time right now. I witnessed impact first hand and advised on the implementation and refinement for the group that built it.
- photon_collider 2y agoI agree that LLMs are less useful for smaller scale use cases. I’ve found success using them for creating mock data, reformatting unstructured text into structured data, and a few other menial tasks that would take me a while to do on my own. I think so much of the hype is about potential larger scale applications but the models just don’t seem reliable enough yet for that.