3 ms·
Not sure what you mean by 'using'. The prompt is from one of the benchmarks used in scoring LLM models - don't recall which. Here is another from BBH [1]: >>>
by sorokod 3y ago
Not sure what you mean by 'using'. The prompt is from one of the benchmarks used in scoring LLM models - don't recall which. Here is another from BBH [1]:
>>> (-1 + 2 + 9 * 5) =
... (-1 + 2 + 9 * 5) = 43
[1] https://github.com/suzgunmirac/BIG-Bench-Hard/tree/main https://github.com/suzgunmirac/BIG-Bench-Hard/tree/main
- GaggiX 3y agoThis is even worse than the other, just straight up use a calculator.
- freilanzer 3y agoThe use isn't the calculation, but the benchmark for its arithmetic capability.
- deleted 3y ago[deleted]