3 ms·
> Inferences are speedy, looks promising for a local solution compared to other models which have been released recently. Is there any kind of standardized tes
by MuffinFlavored 3y ago
> Inferences are speedy, looks promising for a local solution compared to other models which have been released recently.
Is there any kind of standardized test to gauge the quality (not the speed) of LLM answers? aka, how hard does it hallucinate?
- rgovostes 3y agoThere is the Language Model Evaluation Harness project which evaluates LLMs on over 200 tasks. HuggingFace has a leaderboard tracking performance on a subset of these tasks. https://github.com/EleutherAI/lm-evaluation-harness https://github.com/EleutherAI/lm-evaluation-harness https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...