Well said. As someone with only a math undergrad and as a math RLHF’er, this speaks to my experience the most. That craving for an understanding an elegant pro

Well said. As someone with only a math undergrad and as a math RLHF’er, this speaks to my experience the most. That craving for an understanding an elegant proof is nowhere to be found with verifying an LLM’s proof. Like sure, you could put together a car by first building an airplane, disassembling all of it minus the two front seats, and having zero elegance and still get a car at the end. But if you do all that and don’t provide novelty in results or useful techniques, there’s no business. Hell, I can’t even get a model to calculate compound interest for me (save for the technicality of prompt engineering a python function to do it). What do I expect?