4 ms·
If it just decides on a single token at a time, can it backtrack and choose differently under that operation, given the next tokens? What I wonder is, how can i
by goldfeld 4y ago
If it just decides on a single token at a time, can it backtrack and choose differently under that operation, given the next tokens? What I wonder is, how can it plan ahead and output meaningful (to us) responses, like working code or useful articles? How can it "reason" logically when it needs to solve a problem, a riddle etc, by only selecting a token at a time? Wouldn't that dumbed down approach prove myopic for complex compositions? Doesn't it need some over-ruling goal-based heuristic system?
- psychphysic 4y agoBard at least produces multiple drafts. I believe that is preferred over backtracking. Generation is ultimately deterministic (seeded prng) so backtracking wouldn't make sense.
- wingspar 4y agoThere’s no planning, no reason. It’s all ‘what word is next…’ I found Stephen Wolframs explanation helpful. He has a YouTube video version which I enjoyed too. This blog post was on HN last month, but I never get good search results on hn https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
- zeven7 4y agoIt is wild that a process like that can generate working code. Humans speak their words in order, but they don't write their code in order. Why would writing code in order work?
- flangola7 4y agoWith GPT-4 this process also allows it to understand what is inside a graphical image and talk intelligently and coherently about it. Next token prediction produces the most head exploding emergent effects.
- goldfeld 4y agoIf we get a bit quantum (or an act of God for some), then backtracking could happen by collapsing the dead-ends and "changing" history to stay with what turns out to be the solid plan. Could emergent conscience on AI's neurons do the planning and reasoning that it rather seems to be doing but ML experts will say it is not? If our conscience could by any chance reside not in the electrical currents of the wetware, could AI's reason also not reside in tokens? Is there some mysterious process possible to be taking place?
- resters 4y agoIt seems that the output feels reasoned because of the reasoning implicit in language patterns. Which is enough to write code and essays, apparently.
- goldfeld 4y agoN.B. to self: study more Foucault to grasp this.