6 ms·
> They are statistical text generators, whose results are defined by their training data set Honestly I'm pissed at the research community. It's fraud. If you
by godelski 2y ago
> They are statistical text generators, whose results are defined by their training data set
Honestly I'm pissed at the research community. It's fraud. If you don't know what's in the training data you simply cannot differentiate reasoning from memorization.
Beyond that, the experiments are almost certainly in the training data. Like come on! I feel like I'm going crazy here. How can any coder not think LLMs are training on oct and hex‽
https://news.ycombinator.com/item?id=41422751 https://news.ycombinator.com/item?id=41422751
- famouswaffles 2y agoOf course they've been trained on oct and hex. The question is would the results be largely valid if this was done on a human who had learnt how to perform base 8, 9, 11 etc arithmetic instead ? I mean, they're clearly not trying to test the ability to derive base arithmetic from scratch.
- deleted 2y ago[deleted]