Yes, I feel like asking an LLM this type of problem is like giving someone access to Google during an open book math test. It’d be interesting to obfuscate it

Yes, I feel like asking an LLM this type of problem is like giving someone access to Google during an open book math test. It’d be interesting to obfuscate it so that the concepts are all the same but the subject matter would be hard to google for. Another failure mode for LLM’s is if you take something with a well-known answer and add a twist to it.