2 ms·
Sounds like a further improvement in the spirit of HRM & TRM models. Decent comment via x: https://x.com/r0ck3t23/status/2002383378566303745 https://x.com/r0ck
by marojejian 10mo ago
Sounds like a further improvement in the spirit of HRM & TRM models.
Decent comment via x:
https://x.com/r0ck3t23/status/2002383378566303745 https://x.com/r0ck3t23/status/2002383378566303745
I continue to be fascinated by these architectures that:
- Build in recurrence / inference scaling to transformers more natively.
- Don't use full recurrent gradient traces, and succeed not just despite, but because of that.