2 ms·
I was discussing LLMs with a non technical person on the plane yesterday. I was explaining why LLMs aren't good at math. And, he responded, no, chatgpt is great
by xrd 3y ago
I was discussing LLMs with a non technical person on the plane yesterday. I was explaining why LLMs aren't good at math. And, he responded, no, chatgpt is great a multivariate regression, etc.
I'm using LLMs locally almost always and eschewing API backed LLMs like chatgpt. So I'm not very familiar with plugins, and I'm assuming chatgpt plugs into a backend when it detects a math problem. So it isn't the LLM doing the math but to the user it appears to be.
Does anyone here know what LLM projects like llama.cpp or gemma.cpp support a plugin model?
I'm interested in adding to the dungeons and dragons system I built using llama.cpp. Because it doesn't do math well, the combat mode is terrible. But I was writing my own layer to break out when combat mode occurs, and I'm wondering if there is a better way with some kind of plugin approach.
- staticman2 3y agoSillytavern is a front end for local and cloud models. They have a simple scripting language and there's been some experiments with adding game functionality with it: https://chub.ai/characters/creamsan/team-neko-e4f1b2f8 https://chub.ai/characters/creamsan/team-neko-e4f1b2f8 This one says it uses javascript as well: https://chub.ai/characters/creamsan/tessa-c4b917f9 https://chub.ai/characters/creamsan/tessa-c4b917f9 Thise are the only two listed as SFW. There's some others if you hit the nsfw toggle and search for the scripted tag.I don't know if this is the right approach but you could also write a module for Sillytavern Extras.