3 ms·
Yeah it s because they have a strong prior on unsolved problems being unsolvable. Once the idea of AI routinely solving conjectures enters the training data th
by bananaflag 1mo ago
Yeah it s because they have a strong prior on unsolved problems being unsolvable.
Once the idea of AI routinely solving conjectures enters the training data this encouragement will disappear like 2023-era prompt engineering did.
- arscan 1mo agoI would think this type of behavior (ugh, or dare I say default mindset) by consumer-facing LLMs will always be desirable for ‘hard’ problems (things previously unsolved) because it’s a bit like having saftey mechanisms in place to prevent hallucinations for users incapable of verifying correctness of the output. You’ve got to do a little work to prove you understand that it’s hard but it’s still something the LLM might be able to accomplish.
- rowanG077 1mo agoI think this is also a healthy mindset for a person to have in many cases. If my boss asks me "go solve P = NP", as extreme example, I would also give some pushback.
- skybrian 1mo agoIt will likely burn a lot of tokens, take a long time, and might not work, so hopefully they'll still ask if you really want to spend the money on the attempt.
- empath75 1mo agoI spent about a month walking through proving something with Claude a few months ago and it _constantly_ told me that it was impossible and I should stop working on it, right up until it proved it.