8 ms·
The same authors also have a language model at https://github.com/Zyphra/Zamba2 https://github.com/Zyphra/Zamba2 but it's not clear to me if that model is conne
by tveita 2y ago
The same authors also have a language model at https://github.com/Zyphra/Zamba2 https://github.com/Zyphra/Zamba2 but it's not clear to me if that model is connected to tree attention.
The announcement at https://www.zyphra.com/post/zamba2-small https://www.zyphra.com/post/zamba2-small links to this paper, but the paper doesn't actually mention Zamba2 anywhere.