4 ms·
Which makes you wonder what would happen if you gave ChatGPT two streams of output: one for "speech" and one for inner-monologue-style "thinking". For most of
by jmoss20 4y ago
Which makes you wonder what would happen if you gave ChatGPT two streams of output: one for "speech" and one for inner-monologue-style "thinking".
For most of our "hmm, let me think"'s I'm not sure what we do is significantly more complicated than that. We just get to hide the inner monologue.
- Jensson 4y agoLetting it decide how much time computing an answer instead of making it spend the same amount of time per text token could definitely help a lot. Right now it spends the same amount of energy processing each token, but that doesn't make sense, "hello, how are you" should take basically no processing while hard logical problems should take a lot. Maybe these language models could be way smaller and cheaper if we added a recurse symbol to it that made it iterate many times. Hard tasks would still take a lot, but most banal conversations would be very cheap.
- jmoss20 4y agoThis does indeed improve efficiency significantly: https://arxiv.org/abs/2207.07061 https://arxiv.org/abs/2207.07061
- flangola7 4y ago>one for inner-monologue-style "thinking". I'm not sure I know what you're talking about.
- taneq 4y agoAnd here we go on the aphantasia / does everyone have an inner monologue / can you make your ears rumble / do you sit or stand when pooping train. :P
- zoklet-enjoyer 4y agoMake your ears rumble? Stand while pooping? What???
- taneq 4y agohttps://happymag.tv/apparently-ear-rumbling-is-a-thing-and-only-some-people-can-do-it/ https://happymag.tv/apparently-ear-rumbling-is-a-thing-and-o... https://www.reddit.com/r/AskReddit/comments/ajhnv/sit_or_stand_while_wiping/ https://www.reddit.com/r/AskReddit/comments/ajhnv/sit_or_sta... I misremembered, it was wiping apparently.