3 ms·
For something to generate text that is believable on a level like gpt-4 does it needs to have some model of the real world and understand relationships between
by Loeffelmann 3y ago
For something to generate text that is believable on a level like gpt-4 does it needs to have some model of the real world and understand relationships between things. So yes the training goal was to "just predict the next word" same as our training goal was just "reproduce and survive". What emerged out of that is the real important thing.
No human can understand what really happens in the billion of calculations done for each token in gpt-4 so how can you claim that there is surely no thought process going on? It can solve some riddles, it can draw pictures and it can reason (to some extend). How is that just generating text to you?
In the end this argument doesn't matter because how it was made is irrelevant. What matters is what it is and can do.
- ttpphd 3y agoThe God of the gaps is now accessible via API.
- danaris 3y ago"I don't understand how the things GPT-4 does could be possible without genuine understanding an a model of the world, so it must have those things (despite there being no evidence from its building blocks or the structure with which it is built that it could be capable of those things)."
- newswasboring 3y agoI haven't seen proof that it could be capable of those things so I will boldly assert it's definitely not doing that. Everyone needs to calm down and realize we don't need to have all the answers right now.