3 ms·
I think it could indicate that "semi-private" dataset likely leaked to their training data.
by andriy_koval 1mo ago
I think it could indicate that "semi-private" dataset likely leaked to their training data.
- IshKebab 1mo agoIt says "Provider Adapter" so presumably they put some manual work in to make this work.
- xpct 1mo agoA dataset being as popular as their's is will contaminate the data just by people discussing it and creating their own public test sets of similar problems. Still, probably not that much compared to employees targeting it.