4 ms·

LLMs create their smallest transformer for 10-digit addition

• marojejian 8mo ago
  They eventually get down to 970 params: https://x.com/DimitrisPapail/status/2024596491474554902?s=20 https://x.com/DimitrisPapail/status/2024596491474554902?s=20