3 ms·

LLMs aren't improving at things they're unable to do at all. An example being reasoning.

• olalonde 3y ago
  LLMs can reason. You can verify this empirically by asking questions which require reasoning to e.g. GPT-4.
  • samatman 3y ago
    False. https://arxiv.org/abs/2308.03762 https://arxiv.org/abs/2308.03762
    • olalonde 3y ago
      This is not peer reviewed research and has some serious issues: https://news.ycombinator.com/item?id=37051450 https://news.ycombinator.com/item?id=37051450
  • lossolo 3y ago
    There is evidence that they actually can't reason: https://arxiv.org/abs/2311.00871 https://arxiv.org/abs/2311.00871 https://arxiv.org/abs/2309.13638 https://arxiv.org/abs/2309.13638 https://arxiv.org/abs/2311.09247 https://arxiv.org/abs/2311.09247 https://arxiv.org/abs/2305.18654 https://arxiv.org/abs/2305.18654 https://arxiv.org/abs/2309.01809 https://arxiv.org/abs/2309.01809