4 ms·
> write a multithreaded sudoku solver in one shot I did not say anything about threads but I did hint at the fact that coroutines can be used creatively to sol
by climatologist 3y ago
> write a multithreaded sudoku solver in one shot
I did not say anything about threads but I did hint at the fact that coroutines can be used creatively to solve problems which require backtracking and constraint propagation. The fact that this is still controversial means a lot of people are unaware LLMs do not support backtracking, recursion, and constraint propagation. Sudoku is just an obvious example of a problem that is easy to solve if you know about these concepts and next to impossible if you don't. Such problems can also be expressed as integer programs but even fewer people know how to do that so I don't usually bring it up but it would be another good test for any software system that is claimed to be intelligent by the corporate marketing department.
- IanCal 3y agoLlms don't have to support something internally to know about those concepts, those are entirely different things. > Such problems can also be expressed as integer programs but even fewer people know how to do that so I don't usually bring it up but it would be another good test for any software system that is claimed to be intelligent by the corporate marketing department. It's very telling if the level of testing is "can it do something few people in the field can?".
- climatologist 3y agoWhat exactly are you confused about? Plenty of people can learn about constraint propagation and integer programming but LLMs do not have the capability to solve integer programs because LLMs (and neural networks in general) are not generally intelligent.
- IanCal 3y agoI'm not confused I'm saying you're conflating two things - understanding something and being able to perform it in a single pass. Neither llms nor humans have to be able to solve a sudoku puzzle to write code that can. I can be awful at mental arithmetic and write code for a calculator.
- climatologist 3y agoOk, let me know if you can get an LLM to solve sudoku puzzles by prompting it with information on backtracking and recursion.
- IanCal 3y agoNo prompting on backtracking or recursion, that was chosen by the LLM. All I did was tell it to break the problem down and reason about it, then afterwards asked it to write the code. Examples were added by me at the end, from a random sudoku site for "easy" and "hard". https://gist.github.com/IanCal/9817f8b21b2ea6d77940966ee399d2de https://gist.github.com/IanCal/9817f8b21b2ea6d77940966ee399d...
- climatologist 3y agoYou misunderstood what I meant. Prompt the LLM with the sudoku puzzle and ask it to solve it and not write python. Human can do it, LLM can not.