3 ms·
> Basically want to feed the model a huge set of prompts, have it produce output, and then have other LLMs eval the results. Then our team can dig in to areas t
by ziggyzecat 2y ago
> Basically want to feed the model a huge set of prompts, have it produce output, and then have other LLMs eval the results. Then our team can dig in to areas the judges disagree.
A few weeks later: "oops".
You have to build your own tools and sets for RAG, but you know that. Don't slack off, when it comes to testing and evaluation of LLMs, nobody can be trusted yet.