3 ms·
I'm reminded of the infamous vending machine benchmark: https://arxiv.org/abs/2502.15840 https://arxiv.org/abs/2502.15840 in which some LLMs simply failed to
by duskwuff 1y ago
I'm reminded of the infamous vending machine benchmark:
https://arxiv.org/abs/2502.15840 https://arxiv.org/abs/2502.15840
in which some LLMs simply failed to manage the basic task of keeping a vending machine stocked with products to sell, and some went completely off the rails, e.g. by threatening their (simulated) supplier with "ABSOLUTE FINAL ULTIMATE TOTAL NUCLEAR LEGAL INTERVENTION".