4 ms·
That doesn't make any sense to me. Seems like you're trying to blame one LLM revision for something that went wrong. It oozes a smell of unaccountability. Thu
by alganet 2y ago
That doesn't make any sense to me.
Seems like you're trying to blame one LLM revision for something that went wrong.
It oozes a smell of unaccountability. Thus, unaligned. From tech to public relations.
- Trasmatta 2y agoExcept that's literally how LLMs work. Small changes to the prompt or training can greatly affect its output.
- qrian 2y agoI can totally believe that they deployed it because internal metrics looked good.
- n8m8 2y agoIt seems more like they valued quantitative data in the form of A/B testing higher than their "vibe checks". The point I took away from the paper is in the context of LLMs, quantitative A/B testing isn't necessarily better than a handful of experts giving anecdotes on if they like it. In my experience, smart leaders tend to rely on data and hard numbers over qualitative and anecdotal evidence, and this paper explores this exception. I'm disappointed they didn't address the paper about GPT integrating with ChatbotArena that was shared here on HN a couple days ago.
- alganet 2y agoSo what?