4 ms·
Yeah. I immediately thought: I wonder if that 56% is in one or two categories and the rest are worse?
by afro88 2y ago
Yeah. I immediately thought: I wonder if that 56% is in one or two categories and the rest are worse?
- rvnx 2y ago44% of the people prefers the existing model ?
- KHRZ 2y agoWith many people too lazy to read 2 walls of text, a lot of picks might be random.
- afro88 2y agoEach question falls into a different category (ie math, coding, story writing etc). Typically models are better at some categories and worse at others. Saying "56% of people preferred responses from o3-mini" makes me wonder if those 56 are only from certain categories and the model isn't uniformly 56% preferred.