4 ms·
They're in roughly the same class but totally different architectures Deepseek uses a 4k sliding window compared to Codestral Mamba's 256k+ tokens
by ed 2y ago
They're in roughly the same class but totally different architectures
Deepseek uses a 4k sliding window compared to Codestral Mamba's 256k+ tokens