voooduuuuu

3 ms·

1. 1.▲
   by voooduuuuu 5mo ago

   Ask an LLM to invent a new word and post it here. You will see that it simply combines words already in the training data.
2. 2.▲
   by voooduuuuu 5mo ago

   Ask an LLM to invent a new word and post it here, I will be waiting. You will see that it simply combines words already in the training data.
3. 3.▲
   by voooduuuuu 5mo ago

   I think you are conflating composition and prediction. LLMs don't compose higher abstractions from the "axioms, symbols and rules", they simply predict the next token, like a really large spinning wheel.