Someone made a framework to make and test llms on your own benchmarks you might find it useful https://github.com/carlini/yet-another-applied-llm-benchmark ht

Someone made a framework to make and test llms on your own benchmarks you might find it useful https://github.com/carlini/yet-another-applied-llm-benchmark https://github.com/carlini/yet-another-applied-llm-benchmark