3 ms·
Ask each model to score and rank its own answer and each other. It's AI turtles all the way down.
by throwup238 3y ago
Ask each model to score and rank its own answer and each other. It's AI turtles all the way down.
- riku_iki 3y agoSomeone should build this as a service
- muzani 3y agoOnce they're faster and cheaper, it'll probably end up a standard pattern taught in school.
- nilsherzig 3y agoI think a lot of local LLM benchmarks are evaluated by gpt4 haha
- sorokod 3y agoIf you iteratively score, request improvement, and submit do results converge to a score value? If not, what do you think that means?
- brokensegue 3y agoThey aren't good at scoring their own work in my experience