3 ms·
Qualcomm wanted to run Stable Diffusion on phones as well, and IIRC they published a demo, but no one cared because it was a barebones demo. MLC-LLM already ru
by brucethemoose2 3y ago
Qualcomm wanted to run Stable Diffusion on phones as well, and IIRC they published a demo, but no one cared because it was a barebones demo.
MLC-LLM already runs LlamaV1 (and probably V2?) performantly on Android and iOS. But again, no one seems to care because its a relatively barebones demo.
Qualcomm needs to build and extensive feature set and probably a UI, otherwise no one is going to care about this implementation either.