3 ms·
https://github.com/NimbleEdge/sparse_transformers https://github.com/NimbleEdge/sparse_transformers and https://www.reddit.com/r/LocalLLaMA/comments/1l44lw8/spa
by nrjpoddar 1y ago
https://github.com/NimbleEdge/sparse_transformers https://github.com/NimbleEdge/sparse_transformers and https://www.reddit.com/r/LocalLLaMA/comments/1l44lw8/sparse_transformers_run_2x_faster_llm_with_30/ https://www.reddit.com/r/LocalLLaMA/comments/1l44lw8/sparse_... were the inputs