9 ms·
I'm skeptical, expect data contamination was the reason for high benchmark scores.
by ipsum2 3y ago
I'm skeptical, expect data contamination was the reason for high benchmark scores.
- hiddencost 3y agoYeah. IBM especially has a history of fudging the numbers on reports like this. Research puts together reports which are aggressively p-hacked and ensembled and overfit, and then sales uses those reports to boondoggle clients into using IBM.