Just like with neural networks and Adam [1], LLMs evolve to make transformers their best building block. [1] https://parameterfree.com/2020/12/06/neural-networ

Just like with neural networks and Adam [1], LLMs evolve to make transformers their best building block. [1] https://parameterfree.com/2020/12/06/neural-network-maybe-evolved-to-make-adam-the-best-optimizer/ https://parameterfree.com/2020/12/06/neural-network-maybe-ev...