4 ms·
it seems to me also, that this is very much some sort of snake oil for the llm era. prompt generation varies from llm-to-llm and I doubt gpt4 can do reasonable
by larodi 3y ago
it seems to me also, that this is very much some sort of snake oil for the llm era. prompt generation varies from llm-to-llm and I doubt gpt4 can do reasonable evaluation, provided that it does not know at all about other models.
- londons_explore 3y agoThe various leaderboards show that, in aggregate, LLM's acting as evaluators match other LLM's and humans remarkably closely.