48 ms·

Does this mean LLMs might do better if trained on large amounts of student notes, exams, book reviews and such? That would be incredibly interesting.

• GarnetFloride 2y ago
  I have wondered that from time to time, why not train an AI system using educational curricula plus some games and play? It might be fascinating to see what comes out using various systems from around the world.
  • ilaksh 2y ago
    They do train on textbooks.
    • naasking 2y ago
      Yes, but maybe they should train more on uncertainty and mistakes, that are later followed by clarifications and corrections, like those found in notes.
    • qeternity 2y ago
      Textbooks are all you need - https://arxiv.org/pdf/2306.11644 https://arxiv.org/pdf/2306.11644
• jpcom 2y ago
  Yep.