3 ms·

I built my own arena for benchmarking local LLMs on a suite of small projects intended to grade the models on workflows I am likely to use them for. You can vi

I built my own arena for benchmarking local LLMs on a suite of small projects intended to grade the models on workflows I am likely to use them for. You can view my leaderboard: https://spottedmarley.com/arena https://spottedmarley.com/arena

ed-is-ai 2mo ago
neat! I will check it out. I'm not really using local LLMs as dont have a big enough machine for these to run with a decent tps
ed-is-ai 2mo ago
It looks like you're mostly 1-shotting apps and reviewing the results based on # interventions etc Like it!!