4 ms·
I think this is how we get ML models to come up with novel ideas. Diagonalize against all the ideas they’ve already tried and dismissed via self-argument but ke
by Xcelerate 1y ago
I think this is how we get ML models to come up with novel ideas. Diagonalize against all the ideas they’ve already tried and dismissed via self-argument but keep certain consistency constraints. (Obviously much easier said than done.)
- andai 1y agoWhat you just said is what I tried and failed to say ten minutes ago! https://news.ycombinator.com/item?id=43835798 https://news.ycombinator.com/item?id=43835798
- Nevermark 1y agoIt’s working! Oh, wait … These models have limitations obviously, but many critiques apply equally or more to people. If people were tasked with one shot, 10 second answers, to be written out in near errorless grammar, the LLM’s viewing our responses to prompts would be spending a lot of time discussing our limitations and how to game us into better responses. Humor, not at all humor.
- jwally 1y agoScaled up and spread out - this probably gets you pretty close to consciousness(?) Conway's game of life, but instead of colored squares with rules, they're LLM's with some kind of weighting - all chattering back and forth with one another - bubbling up somehow to cause speach/action
- lubujackson 1y agoDecades ago I read The Society of Mind by Marvin Minsky. He pushed this sort of idea, that consciousness is composed of individual, competing processes. Worth a revisit!