4 ms·
Isn't that basically a recurrent neural network?
by trextrex 2y ago
Isn't that basically a recurrent neural network?
- eigenvalue 2y agoI can see where you’re coming from, but not really. Unlike an RNN, the main transformer still processes sequences non-recurrently. The “sidecar” model just encodes internal activations into compressed latent states, allowing introspection and rollback without changing the underlying transformer architecture.