4 ms·
Now that StackOverflow has been killed (in part) by LLMs, how will we train future models? Will public GitHub repos be enough? Precise troubleshooting data is
by goldenarm 10mo ago
Now that StackOverflow has been killed (in part) by LLMs, how will we train future models? Will public GitHub repos be enough?
Precise troubleshooting data is getting rare, GitHub issues are the last place where it lives nowadays.
- deleted 10mo ago[deleted]
- Vaslo 10mo agoThey would just use documentation. I know there is some synthesis they would lose in the training process but I’m often sending Claude through the context7 MCP to learn documentation for packages that didn’t exist, and it nearly always solves the problem for me.
- nicoburns 10mo agoThe brilliance of StackOverflow was in being the place to find out how to do tricky workarounds for functionality that either wasn't documented or was buggy such that workarounds were needed to make it actually work. Software quality is now generally a bit better than it was in 2010, but that need is ultimately still there.
- robryan 10mo agoAssuming these end up in open source code llms will learn about them that way.
- bluedino 10mo agoAren't a lot of projects using LLMs to generate documentation these days?
- gitaarik 10mo agoThey pay lots of humans to train the LLMs..