6 ms·
I wonder how much longer this "Using LLMs to evaluate the quality of other LLMs" can last. Certainly it has proven valuable and useful up until now, especially
by andy_xor_andrew 3y ago
I wonder how much longer this "Using LLMs to evaluate the quality of other LLMs" can last. Certainly it has proven valuable and useful up until now, especially since ChatGPT is a pretty high bar to evaluate against.
But it also seems like a strange, incestuous, closed system approach.
Like, unless you are introducing something new into the system, you just have the system churning against itself, probably until it reaches an equilibrium (or else becomes incoherent).
- anothernewdude 3y agoI wonder how long "Using humans to rate the quality of other humans" thing can last. Surely academia has only so long before it collapses.
- plagiarist 3y agoYou're asserting that current LLMs are as capable as evaluating each other as are humans with advanced degrees?
- jacooper 3y agoAlso humans aren't exact clones
- anothernewdude 3y agoYes. They're both awful.