3 ms·
I think everyone should have a test in their back pocket for testing claims made by companies making AI tools. Mine is backtracking sudoku solver with constrain
by climatologist 3y ago
I think everyone should have a test in their back pocket for testing claims made by companies making AI tools. Mine is backtracking sudoku solver with constraint propagation but that's because I know LLMs are incapable of recursion and backtracking. Usually people get the point I'm making but sometimes I have to elaborate further.
LLMs are cool toys but calling them intelligent is stretching the definition of "intelligent" way too far. It's important to be clear about what the words actually mean because if people start thinking these software systems can be substituted for their own thinking then we end up with all sorts of unnecessary confusion around what they're actually capable of achieving.
- famouswaffles 3y agoAny test a lot of humans will fail is simply not a test of General Intelligence. That should be obvious enough. And GPT-4 does do this in a couple iterations.
- climatologist 3y agoHumans are not generally intelligent.
- IanCal 3y agoThen you have a wildly different bar than the vast majority of the people in any agi conversation and should state this upfront.
- climatologist 3y agoWhat exactly do you want me to state up front? A general intelligence can solve general problems when those problems are formally specified. Sudoku is a good example of a formally specified problem that can be solved by most people but not by LLMs. This is because LLMs and all neural networks are simply DAGs of function which do not support recursion or backtracking. Adding recursion to neural networks has been tried a few times but no one actually knows how to stabilize their dynamics so the industry has settled on feed forward networks with constrained function blocks which have stable dynamics with respect to back propagation of errors.
- IanCal 3y agoI don't understand your question. > What exactly do you want me to state up front? Exactly what was in your comment that I told you to state up front. Most people in a discussion about AI and replacing people are working with a definition of general intelligence that includes humans to a large degree. > This is because LLMs and all neural networks are simply DAGs of function which do not support recursion or backtracking. Without adding external state I can't solve a sudoku puzzle.
- climatologist 3y agoOk great, next time I run into you I'll make sure to remind you that large language models are not intelligent as I conceive of the word "intelligent".