3 ms·
Am I understanding correctly that Mamba SSM's can be used for autoregressive sequence modeling, on both continuous and discrete data?
by eli_gottlieb 3y ago
Am I understanding correctly that Mamba SSM's can be used for autoregressive sequence modeling, on both continuous and discrete data?
- ttul 3y agoThe paper claims that Mamba outperforms Transformers on modeling audio waveforms. Once a signal gets into a computer, it is technically always discrete, but I think what you’re referring to here is the ability to model continuous signals like audio and discrete data such as written language. Am I reading you right?
- eli_gottlieb 3y agoYes I am indeed talking about that distinction.