3 ms·
Where does one find this TVM implementation you mention?
by UncleOxidant 3y ago
Where does one find this TVM implementation you mention?
- capableweb 3y agoMaybe they're talking about https://github.com/mlc-ai/mlc-llm https://github.com/mlc-ai/mlc-llm which is used for web-llm (https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm)? Seems to be using TVM.
- brucethemoose2 3y agoYep. Its very fast on Vulkan, and from what I understand fast on metal, but its not as feature packed as llama.cpp yet.