3 ms·
I don't really know what kind of breakthrough they could achieve. The only other step function improvements I could imagine right now are: 1. A great technique
by casualscience 3y ago
I don't really know what kind of breakthrough they could achieve. The only other step function improvements I could imagine right now are:
1. A great technique for memory banking: e.g. A model which can have arbitrarily large context windows (i.e. like a human who remembers things over long periods of time).
2. Better planning abilities: e.g. A model which can break problems down repeatedly with extremely high success and deal with unexpected outcomes/mistakes well enough that it can achieve replacing a human in most scenarios.
Other than that, CGPT is already a better logician than I am and is significantly better read... not sure what else they can do. AGI? I doubt it.
- yinser 3y agoComplete speculation but they don’t have to be referring, if there is anything at all, to heuristic search and dynamic programming. No LLM involvement whatsoever.
- riwsky 3y agoNah dude they just need to give baby the iPad and let it watch literally all of YouTube
- drexlspivey 3y agoA model that can learn from it’s users would be interesting albeit scary. Sometimes when chatGPT fails to produce the right answer in coding tasks I paste back the solution when I figure it out. I know it can’t learn from it but it might be helpful if I continue the same chat.