2 ms·
13B finetunes are quite "smart" at what they do and can fit on modern phones. 7B is reasonably fast running Vulkan/Apache TVM via mlc-llm, not sure if 13B has a
by brucethemoose2 3y ago
13B finetunes are quite "smart" at what they do and can fit on modern phones. 7B is reasonably fast running Vulkan/Apache TVM via mlc-llm, not sure if 13B has a profile yet.
Check out the 13B finetunes on HF: https://huggingface.co/models?sort=modified&search=13b https://huggingface.co/models?sort=modified&search=13b