knightoffaith

22 ms·

181.
by knightoffaith 3y ago
I don't have my copy with me right now, so perhaps I'm misremembering, but I recall Hofstadter explaining in the preface of my copy that the point of his book was how the mind - consciousness - could arise from the brain (or somet
182.
by knightoffaith 3y ago
Do you remember what you were confused about? The book does not assume the reader has any advanced math education (from what I remember) - it tries to teach you the relevant math itself. It is long and windy though, so maybe you read throug
183.
by knightoffaith 3y ago
I thought I would start seeing red and frothing at the mouth when I read this, but this is actually a pretty reasonable take. I wouldn't say that the takeaway is that open source is just a diversion though - it's just that we shou
184.
by knightoffaith 3y ago
Why doesn't physics or mathematics allow LLMs to reason?
185.
by knightoffaith 3y ago
Yeah, I think this is right. GNU/Linux works perfectly fine for the normal person's use case - the main issue is that it's not the default, and switching is a pain. Really, GNU/Linux should be the default. People have th
186.
by knightoffaith 3y ago
I'm not sure that AI has been successful recently because of its similarities to the human brain. It seems like the project of making human-like AI (in the sense of, models that function similarly to the brain) have had a lot less empi
187.
by knightoffaith 3y ago
Your expectations are pretty high. Differentiable architecture search as you mentioned in the original comment is one thing; going beyond empirical risk minimization-based learning is another thing entirely. In fact, they seem mostly orthog
188.
by knightoffaith 3y ago
I wonder why this hasn't taken off.
189.
by knightoffaith 3y ago
How can gradient descent work on compute graphs when the space of compute graphs is discrete?
190.
by knightoffaith 3y ago
It's quite strange to include LSTMs/GRUs/RNNs here. I can maybe see why a programmer should be familiar with generative AI, and how a neural network works at a high level, but people not working in AI (that is, people who are
191.
by knightoffaith 3y ago
I sympathize with these ideas - I love free software, self-hosted stuff, etc. But how are we supposed to make money without proprietary software or SaaS? People always say "it's free as in freedom, not free as in zero price"
192.
by knightoffaith 3y ago
Great that folks are starting to think about this, I think it's important to keep the power of AI decentralized. Thought it seems like for this to be practical, they need to flesh out the Security section in the appendix to deal with b