3 ms·
Teaching an LLM to solve a full sized Sudoku is not a goal right now. As an RLHF I’d estimate it would take 10-20 hours for a single RLHF’er to guide a model to
by meroes 2y ago
Teaching an LLM to solve a full sized Sudoku is not a goal right now. As an RLHF I’d estimate it would take 10-20 hours for a single RLHF’er to guide a model to the right answer for a single board.
Then you’d need thousands of these for the model (or next model) to ingest. And each RLHF’s work needs checking which at least doubles the hours per task.
It can’t do it because RLHF’ers haven’t taught models on large enough boards en masse yet.
And there are thousands of pen and paper games, each one needing thousands of RLHF’ers to train them on. Each game starting at the smallest non trivial board size and taking a year for a modest jump in board size. Doing this in not in any AI company’s budget.
- bccdee 2y agoIf it were actually reasoning generally, though, it wouldn't need to be trained on each game. It could be told the rules and figure things out from there.
- yencabulator 2y agoEven worse, the LLM is supposed to already "know" Sudoku rules. Either that, or it doesn't "know" anything that was scraped from the web...