3 ms·
Good thread I saw on Reddit about this a few days ago. https://www.reddit.com/r/LocalLLaMA/comments/18xbevs/open_llm_leaderboard_is_disgusting/ https://www.red
by politelemon 3y ago
Good thread I saw on Reddit about this a few days ago.
https://www.reddit.com/r/LocalLLaMA/comments/18xbevs/open_llm_leaderboard_is_disgusting/ https://www.reddit.com/r/LocalLLaMA/comments/18xbevs/open_ll...
Many top models are overfitting to top leaderboards rather than be actually useful.
- SubiculumCode 3y agoIt seems so easy for just one poisoned model (trained with test data) to infect a ton of finetune model mixtures...it could happen without intention. Under this scenario, the ones that achieve the top performance are the closest relation to the poison model?