3 ms·
This seems less accurate than `return 1.0` Using the unboundedly unreliable systems to evaluate reliability is just a bad premise.
by blamestross 1y ago
This seems less accurate than `return 1.0`
Using the unboundedly unreliable systems to evaluate reliability is just a bad premise.
- lock1 1y agoCan't wait for (((LLM) Hallucination Risk Calculator) Risk Calculator) Risk Calculator to propagate & magnify the error even further! /j
- cowboylowrez 1y agohave multiple llms and a voting quorum. sort of how we elect politicians. it'll work just as well I guarantee it!
- wongarsu 1y agoBack in the GPT2 times I did use that technique. Also just running the model multiple times with slightly different prompts and choosing the most common response. It doesn't cure all problems but it does lead to better results. It isn't very good for your wallet though