4 ms·
I wonder why that is. Maybe they’re A/B testing assistant prompts, or there’s noise built into the architecture somewhere.
by rytill 3y ago
I wonder why that is. Maybe they’re A/B testing assistant prompts, or there’s noise built into the architecture somewhere.
- nomel 3y agoThere was a post about it a while back. From what I recall, it’s an efficiency/cost reduction side effect, but it could be made deterministic, if they wanted to eat the cost.