3 ms·
> I view this as compelling evidence that current models are more than "stochastic parrots," More evidence against "stochastic parrots" - zero shot translatio
by visarga 2y ago
> I view this as compelling evidence that current models are more than "stochastic parrots,"
More evidence against "stochastic parrots"
- zero shot translation, where LLMs can translate between unseen pairs of languages
- repeated sampling of responses from the same prompt - which shows diversity of expression with convergence of semantics
- reasoning models - solving problems
But my main critique is that they are better seen as pianos, not parrots. Pianos don't make music, but we do. And we play the LLMs on the keyboard like regular pianos.