4 ms·
LLM boosters are so tiresome. You hardly did a rigorous evaluation, the set has been public since October and could have easily been added to the training data.
by suddenlybananas 2y ago
LLM boosters are so tiresome. You hardly did a rigorous evaluation, the set has been public since October and could have easily been added to the training data.
- gdhkgdhkvff 2y agoYour points would be more convincing if you didn’t preface them with arrogant cynicism.
- deleted 2y ago[deleted]
- e1g 2y agoI'm not skilled enough in math to do a rigorous evaluation, so it was a quick check. Terence Tao is skilled enough, and he describes O1's math ability is "...roughly on par with a mediocre, but not completely incompetent graduate student" (good discussion at https://news.ycombinator.com/item?id=41540902 https://news.ycombinator.com/item?id=41540902), and the next iteration O3 just got 25% on his brand new Frontier Math test. Seeing LLMs as useless is banal, but downplaying their rate of improvement is self-sabotage.
- fumeux_fume 2y ago> "...roughly on par with a mediocre, but not completely incompetent graduate student" Let it sink in how vague and almost meaningless that statement is.
- pizza 2y agoWhat types of questions are you hoping to answer for that to be considered a vague statement?