4 ms·
yea, I was also surprised at the lack of apps. I guess we can take a shot at llama-7b, maybe a base model and a storytelling fine tune. we'll have to look into
by omeze 3y ago
yea, I was also surprised at the lack of apps. I guess we can take a shot at llama-7b, maybe a base model and a storytelling fine tune. we'll have to look into which compiler is best, I do want to tinker with the mlc toolchain. will post to HN when we get it working!
- brucethemoose2 3y agoMLC and llama.cpp both have performant metal ports, and mlc has a demo ios app! For story finetunes, I am out of the loop... You have to dig through HF by date to find them, for instance: https://huggingface.co/zarakiquemparte/hermesboros-limarp-7b https://huggingface.co/zarakiquemparte/hermesboros-limarp-7b https://huggingface.co/models?p=1&sort=modified&search=7b https://huggingface.co/models?p=1&sort=modified&search=7b You can also look through what people are hosting on Kobold Horde (a storytelling/rp community) ignoring the old pygmalion/opt models: https://lite.koboldai.net/# https://lite.koboldai.net/# Also, you should at least host an instruct model instead of vanilla llama 7B.