3 ms·
> ChatGPT hasn't overcome any of the fundamental issues, it's just a huge improvement on the things that the original GPTs were good at. Being able to stay cohe
by dragonwriter 4y ago
> ChatGPT hasn't overcome any of the fundamental issues, it's just a huge improvement on the things that the original GPTs were good at. Being able to stay coherent for a trained-in length that gets longer with larger models is different from being internally coherent for 90 years by nature like people are.
People are very often not internally coherent over periods much shorter than 90 years.
- whatshisface 4y agoThe hazily defined ideal of general intelligence - which everyone imagines that they are, but most of us do not live up to all the time, and nobody lives up to every waking moment (or at least before we've had our morning cup of coffee) isn't within the reach of present day transformer architectures because the length of text they can stay coherent over is limited by how far back they can look through their own output. Human beings can form new memories from their outputs that stay with them for the rest of their lives.