4 ms·
It seems self-evident it will, and it's largely self-reinforcing. Less documentation/examples of new tech -> New model doesn't have enough info on new tech to
by spamizbad 2y ago
It seems self-evident it will, and it's largely self-reinforcing.
Less documentation/examples of new tech -> New model doesn't have enough info on new tech to be useful -> Less uptake of new technology -> Less documentation/examples to build a corpus....
I do wonder if this problem could get solved by basically providing documentation explicitly written for LLMs to consume and produce more detailed "synthetic" documentation/examples from. No idea if that's possible or even wise, but probably a problem space worth exploring. Or if these LLMs develop some sort of standardized way to rapidly apply new bodies of work that avoids costly retraining - like kernel modules, but for LLMs.
- cbg0 2y agoSince the current chatbots have the ability to tap into Google Search, it's not unlikely they could gather their own up to date documentation on-the-fly. This would create a slew of new attack vectors where malicious actors will try to add backdoors into the documentation, which the LLM would reproduce. A seasoned software engineer will easily pick it up, but the large amount of folks that are just copy pasting chatbot output to make their own apps will certainly miss it.
- com2kid 2y agoWith people using LLMs instead of googling, there isn't an incentive for people to write tutorial blog posts.
- logifail 2y ago> Less documentation/examples of new tech -> New model doesn't have enough info on new tech to be useful -> Less uptake of new technology -> Less documentation/examples to build a corpus.... Q: Could it be that those who aren't relying on ChatGPT (or similar) might have a significant competitive advantage?
- kdmtctl 2y agoJust a head start. The LLM retraining cycle could probably become shorter and shorter over time.