3 ms·
The wall confronting large language models
- adityaathalye 1y agoEarlier... Training Compute-Optimal Large Language Models (2022) https://arxiv.org/abs/2203.15556 https://arxiv.org/abs/2203.15556 Chinchilla Scaling: A replication attempt (2024) https://arxiv.org/abs/2404.10102 https://arxiv.org/abs/2404.10102