4 ms·
I've been experimenting with using local LLMs (Llama of course) and building d&d games for my kids (not multiplayer but we just pass the phone around in the car
by xrd 3y ago
I've been experimenting with using local LLMs (Llama of course) and building d&d games for my kids (not multiplayer but we just pass the phone around in the car so each kid can have a turn talking to the DM). It's going surprisingly well, and has been a fun way to explain LLMs and the tech behind them. I wrote up the initial experiences here:
https://blog.katarismo.com/2023-05-26-i-m-a-dad-i-replaced-myself-with-an-llm https://blog.katarismo.com/2023-05-26-i-m-a-dad-i-replaced-m...
I'm doing all of it in JavaScript. I'm still not excited about langchain, and the JS version is lagging a lot from the python version. By the way, pocketbase is amazing for something like that.
- 3abiton 3y agoYou lost me at javascript
- xrd 3y agoOK, let me try to recover. :) I'm using JS to wrap around the llama.cpp project. Most of the work is done by that. JS is just used to pull the tokens out, normalize them, and then send them to a real-time database (pocketbase). The frontend is a Svelte app. It's not a lot of code, llama.cpp does almost everything.