5 ms·
Why would this be surprising? That’s exactly how much of the code they were trained on is presented in PRs, Forums, etc.
by devmor 6mo ago
Why would this be surprising? That’s exactly how much of the code they were trained on is presented in PRs, Forums, etc.
- astrange 6mo agoIs that true? That depends on how their web scraping works, like whether it runs client-side highlighting, strips out HTML tags, etc.
- devmor 6mo agoThe highlighting isn't what matters, its the pretext. E.g. An LLM seeing "```python" before a code block is going to better recall python codeblocks by people that prefixed them that way.
- deleted 6mo ago[deleted]