> we could easily run an A/B test I'd object to "easily". It's already hard to measure whether AI is generally worth the cost. Let alone compare models in such

> we could easily run an A/B test I'd object to "easily". It's already hard to measure whether AI is generally worth the cost. Let alone compare models in such detailled ways. It's mostly handwaving and gut feeling Doesn't mean the conclusions are wrong, but biases are strong.