faurroar

3 ms·

1. 1.▲
   by faurroar 1mo ago

   I don't think it's surprising, per say, but that's a consequence of the fact that I don't believe there is some sort of magic threshold at which a system becomes agential. Like I don't necessarily disagree with any
2. 2.▲
   by faurroar 1mo ago

   "Why are we surprised? The model did exactly what it was told, albeit in an unintended, emergent strategy that's very different from what was intended." So you managed to hit upon the exact problem, then slyly appended "
3. 3.▲
   by faurroar 4mo ago

   Hinton and Bengio don't understand how LLMs work?
4. 4.▲
   by faurroar 4mo ago

   Architectures have evolved significantly since then. DeepSeek v4 =/= GPT-3. Even then, a great deal of complexity lies in everything surrounding the architectures e.g. how do you implement them performantly on modern accelerators, ho