4 ms·
the github link in the paper: https://github.com/ridgerchu/matmulfreellm https://github.com/ridgerchu/matmulfreellm it is super easy to try it out, the 2.7B, 1
by throwaway71271 2y ago
the github link in the paper: https://github.com/ridgerchu/matmulfreellm https://github.com/ridgerchu/matmulfreellm
it is super easy to try it out, the 2.7B, 1.3B, 0.37B models are on huggingface, and the generate.py example just works if you have triton 2.2 installed