2 ms·
In some ways, it's a good tool to teach yourself to sus out the real clues to reliability, not format and authoritative tone.
by SubiculumCode 2y ago
In some ways, it's a good tool to teach yourself to sus out the real clues to reliability, not format and authoritative tone.
- j_maffe 2y agoBut that's the thing. The only way to truly find out if it's reliable (>90%) is to check the data yourself.
- SubiculumCode 2y agoThis is why metrics and leaderboards like these are so important (but under reported on): https://github.com/vectara/hallucination-leaderboard https://github.com/vectara/hallucination-leaderboard https://www.kaggle.com/facts-leaderboard https://www.kaggle.com/facts-leaderboard Google Gemni models seem to lead...hopefully the metrics aren't being gamed.