2 ms·
> where you we need to do personal interviews with new models to see if they could be used for a certain job This is already happening. See the arenas like htt
by viraptor 2y ago
> where you we need to do personal interviews with new models to see if they could be used for a certain job
This is already happening. See the arenas like https://chat.lmsys.org/ https://chat.lmsys.org/ where you get two blinded answers and choose the better one, or choose specific models to compare.
- sigmoid10 2y agoI already know about this, but it is more of a playground than a serious testing environment. I'm talking full blown multi-round interviews with varying human teams to look at all aspects of the job. I have not seen anyone outside the field put these kinds of resources into evaluating models for their business purpose. But I feel we are not far from that.