3 ms·
The guy who reviews all of this, is his role in the company fully dedicated to reviewing these eval pipelines?
by yelmahallawy 7mo ago
The guy who reviews all of this, is his role in the company fully dedicated to reviewing these eval pipelines?
- mock-possum 7mo agoYeah - and he’s kind of a black box of a contractor, people kept saying his name, which is unusual, and at first I figured it was some software or other company we were using - eventually I realized it was a real guy, who we just feed LLM results to and he ranks them for us. He’s not a full time employee and I’ve never actually seen him or had any contact with him, so now I think it’s entertaining to imagine that he’s a figment of the CEO’s imagination - his alter ego that takes over after hours and obsessively reviews LLM outputs.