MLC and llama.cpp both have performant metal ports, and mlc has a demo ios app! For story finetunes, I am out of the loop... You have to dig through HF by date

MLC and llama.cpp both have performant metal ports, and mlc has a demo ios app! For story finetunes, I am out of the loop... You have to dig through HF by date to find them, for instance: https://huggingface.co/zarakiquemparte/hermesboros-limarp-7b https://huggingface.co/zarakiquemparte/hermesboros-limarp-7b https://huggingface.co/models?p=1&sort=modified&search=7b https://huggingface.co/models?p=1&sort=modified&search=7b You can also look through what people are hosting on Kobold Horde (a storytelling/rp community) ignoring the old pygmalion/opt models: https://lite.koboldai.net/# https://lite.koboldai.net/# Also, you should at least host an instruct model instead of vanilla llama 7B.