4 ms·
How is attempting to benchmark llms like religion?
by goosejuice 4mo ago
How is attempting to benchmark llms like religion?
- iLoveOncall 4mo agoRe-read the comment I'm replying to, it's not talking about benchmarks, just models.
- goosejuice 4mo agoComparing models via benchmarks or feeling. Question remains. If people were expressing their experiences working with two prolific software consultants across their various industries would you make the same claim? That's not to anthropomorphize the models, but to just put into perspective that the environment and circumstance is a major factor in output.
- iLoveOncall 4mo ago> If people were expressing their experiences working with two prolific software consultants across their various industries would you make the same claim? If they are as ridiculous as they are when it comes to comparing models, yes I would.