3 ms·
Great writeup. Are there any libraries that implement some of the methods described?
by esafak 1y ago
Great writeup. Are there any libraries that implement some of the methods described?
- gdiamos 1y agoScalarLM uses tokenformer adaptors by default, which have learnable key/values https://www.scalarlm.com/blog/tokenformer-a-scalable-transformer-architecture https://www.scalarlm.com/blog/tokenformer-a-scalable-transfo...