3 ms·
> +50% on Big Bench Hard its +50% on few tasks. It is also +50% not against sota, but some their weak baseline. For example they received large boost on obje
by riku_iki 3y ago
> +50% on Big Bench Hard
its +50% on few tasks.
It is also +50% not against sota, but some their weak baseline.
For example they received large boost on object_counting task where their final result is 86% acc, while current sota from https://arxiv.org/pdf/2210.09261.pdf https://arxiv.org/pdf/2210.09261.pdf is 93%