I’m working on a zine. The first issue is on system evals for LLM-driven apps. It’s set in a world where Bear and Fox are opening a cafe with an LLM shoggoth ge

I’m working on a zine. The first issue is on system evals for LLM-driven apps. It’s set in a world where Bear and Fox are opening a cafe with an LLM shoggoth generating custom recipes. Lots of people just going off of vibes to see if their system is working right. That’s a good start, but you’ll need system evals to systematically improve your app. Like Garry says, “don’t raw dog your prompts. Use system evals” https://forestfriends.tech https://forestfriends.tech