3 ms·
Maybe they're talking about https://github.com/mlc-ai/mlc-llm https://github.com/mlc-ai/mlc-llm which is used for web-llm (https://github.com/mlc-ai/web-llm htt
by capableweb 3y ago
Maybe they're talking about https://github.com/mlc-ai/mlc-llm https://github.com/mlc-ai/mlc-llm which is used for web-llm (https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm)? Seems to be using TVM.
- brucethemoose2 3y agoYep. Its very fast on Vulkan, and from what I understand fast on metal, but its not as feature packed as llama.cpp yet.