3 ms·
How is this standing out from https://benchllm.com/ https://benchllm.com/?
by azzarcher 3y ago
How is this standing out from https://benchllm.com/ https://benchllm.com/?
- Eddygandr 3y agoI really dislike benchllm's use of yamls for test cases - I'd rather it be in code. """ input: What's 1+1? Be very terse, only numeric output expected: - 2 - 2.0 """
- jacky2wong 3y agoAgreed. No one should ever have to touch YAML for writing unit tests for LLMs. Ever. Most people writing agents and LLM applications are Python developers/data scientists/ML engineers.