3 ms·
On a side note: working over longer contexts also reminds me of MemGPT(https://github.com/cpacker/MemGPT https://github.com/cpacker/MemGPT) I think a similar co
by ninjahatori 3y ago
On a side note: working over longer contexts also reminds me of MemGPT(https://github.com/cpacker/MemGPT https://github.com/cpacker/MemGPT)
I think a similar concept can be applied to Mamba architecture models too.