3 ms·
How information theory saved my word game
- jamwise 3mo agoInformation theory has been a really fascinating topic to get more acquainted with. Not really related to the crossword, but I highly recommend 3Blue1Brown's video "Compression is Intelligence", https://www.youtube.com/watch?v=l6DKRf-fAAM https://www.youtube.com/watch?v=l6DKRf-fAAM
- yepyoukno 3mo agoCompression is not intelligence. While intelligence and compression both may have similar goals (to optimize paths of information), intelligence negotiates probability (allowing multiple divergent outcomes) while compression requires an idempotent symbolic translation.
- nl 3mo ago> intelligence negotiates probability (allowing multiple divergent outcomes) while compression requires an idempotent symbolic translation. What does this mean? Lossy, non-deterministic compression is a thing. Does that meet the "allowing multiple divergent outcomes" criteria?
- yepyoukno 3mo agoNo, while you loose some details, there is only one direction of determination. Compression is not intelligence!
- nl 3mo agoYou are going to need to explain yourself in more details. > Compression is not intelligence Just saying this doesn't make it so. It's widely accepted that compression and intelligence have a close relationship. I think this summary of Marcus Hutter's work provides some background: https://www.antoinebuteau.com/lessons-from-marcus-hutter/ https://www.antoinebuteau.com/lessons-from-marcus-hutter/
- yepyoukno 3mo ago> algorithmic information theory, arguing that general intelligence is mathematically equivalent to data compression and sequence prediction Then let it be said “algorithmic intelligence” for true “general” intelligence is not constrained by sequence or brevity. There is indirection, substitution, and other variabilities to the chaotic circumstances of real world (“general”) problem solving. All forms of intelligence relate to the reduction of uncertainty. Compression sounds like “shortest path” and sequence sounds like constrained conditions, neither are “general.”
- nl 3mo ago> variabilities to the chaotic circumstances of real world (“general”) problem solving. All forms of intelligence relate to the reduction of uncertainty. Lossy compression is a form of generalization which handles this exact thing.
- yepyoukno 3mo agoLossy compression down samples a preexisting pattern. It does not derive the pattern. How is deduction and lossy compression the same thing?
- Michelangelo11 3mo ago> Marshall McLuhan gets the credit for the medium is the message, but Claude Shannon had beaten him to a colder version of it years earlier: to a machine moving your words, the meaning doesn’t matter at all; only the medium does, and which of its signals can be told apart. Bravo and Delta survive a bad line; B and D don’t. > I didn’t arrive there as a mathematician; I’m not one. > This wasn’t a speed problem I could optimise away. It was a wall, and it asked a question I couldn’t answer Very strong LLM whiff. A line of thought that constantly, constantly turns back on itself, negating and doubting and qualifying in one way or another, is the biggest tell (the classic "It's not X, it's Y," is only the baldest example). Noticing that whiff instantly turns me off from reading on.
- stavros 3mo ago> This wasn’t a speed problem I could optimise away. It was a wall
- jamwise 3mo agoWell it certainly was a wall. That's how I kept describing it to my partner, I was hitting a wall.
- stavros 3mo agoYes but I'm fairly sure you didn't use the words "this isn't a speed problem. It is a wall" when talking to your partner. I liked the post, I just don't like Claude writing every article I read, just like I didn't like every website I visited looking like Bootstrap.
- jamwise 3mo agoYeah that's fair. I might dust off my draft and re-edit myself, I foolishly thought this would lead to a better post, and I guess am not as attuned to the AI smell as others.
- 3mo ago
- terabytest 3mo agoI have the feeling that this article was hurt rather than helped by being written using LLMs. It was really hard to follow, and even though I read it hoping to learn something new, I left feeling more confused than when I started. The feeling while reading was that the prose was trying to hold my hand but had absolutely no empathy for the build up of my understanding over the article. It’s a bit like when, as a child, you’d do homework with your parent and the parent would start saying “don’t you see how it’s obvious that 25/5=5” with no further explanation and a building tone of frustration.
- jamwise 3mo agoSeems like others feel the same. I guess getting an LLM to help with editing was a bad choice. Thanks for the feedback.
- plasticeagle 3mo agoJesus Christ another AI slop post. I give up. Have the internet you fools, enjoy the world of shit you've created. This might even have been an interesting journey if it had been REMOTELY READABLE.
- z0ltan 3mo ago[dead]
- avvt4avaw 3mo agoThis is impossible to read as every other sentence sounds like it was written by an LLM. I had to stop after a few paragraphs.
- jamwise 3mo agoEDIT: I used an LLM as an editor, and clearly that stank. So I just touched up my original draft and updated the page.
- frostpine 3mo agoFor the game, I dont like the hashed/greyed out squares. Looks like its trying to be a black square in a crossword, but it is actually just a hidden letter? Maybe there is a different way to obscure the letter?
- jamwise 3mo agoThanks for the feedback. The premise of the game is you solve each individual word in order, so greyed out cells are places that aren't the next letter for any of the words right now. As you place the letters those cells open up.
- mental_block 3mo agoEven ignoring the llm-speak, the game is frustrating. I love the concept but the puzzle uses archaic words and there is no hint or a way (like sudoku) to enter in guesses (yes I know I can take out a pen). At least, I'd suggest the author to do these puzzles daily and then put some difficulty ranking so people know to manage expectations. Tough words are fine but this game is just slightly obtuse in its approach. It's cool that llms are helping but there is a genuine "human" element of game design which needs various iterations even when you have the mechanic down. Nice job OP on bringing this concept to life though!
- jamwise 3mo agoAppreciate the feedback, thanks for checking it out. To be clear, LLMs were not used to design this game, just to edit my post talking about creating the board generator. And I do play it every day, today was definitely a tougher one, but the variety day by day is by design, which is pretty common in word games. Mini Mot | Jul 1, 2026 ⣤s⣤y⣀e⣀b⣀i⣀o⣀u⣀t⣀o⣀d⣀ Max Mot | Jul 1, 2026 ⣿d⣿b⣿i⣶r⣤i⣤o⣤e⣤l⣤c⣤t⣤s⣤o⣤e⣤ The key to this game is to use your general intuition about English phonetics to deduce where a letter can't go among the available spots on the board. Kind of like Sudoku logic applied to a crossword. So in theory you can solve quite a few words you've never seen before because certain letter sequences just don't work in English, (the premise behind XKCD for example).