2 ms·
In my opinion its a great idea because you get reuse hidden states which allows you to do something akin to thinking/[online learning]. If you only evolve use i
by E-Reverance 10d ago
In my opinion its a great idea because you get reuse hidden states which allows you to do something akin to thinking/[online learning]. If you only evolve use input space outputs you're dealing with more decoding pressure.
Also related to what I was saying see these:
https://arxiv.org/pdf/2609.16372v1 https://arxiv.org/pdf/2609.16372v1
https://arxiv.org/pdf/2609.01449v1 https://arxiv.org/pdf/2609.01449v1 (this one is quite mindblowing cause they noise they the actual input space every time but it still works)
https://arxiv.org/pdf/2609.11801 https://arxiv.org/pdf/2609.11801
- schopra909 10d agoThanks for the references! I’ll have to take a deeper look, haven’t read these before.