Thanks for sharing, looks interesting! I've actually been using a similar LLM evaluation tool called Arthur Bench: https://github.com/arthur-ai/bench https://g

Thanks for sharing, looks interesting! I've actually been using a similar LLM evaluation tool called Arthur Bench: https://github.com/arthur-ai/bench https://github.com/arthur-ai/bench Some great scoring methods built in and a nice UI on top of it as well