6 ms·
I imagine as architectures evolve these language models will need less and less data to improve.
by valine 4y ago
I imagine as architectures evolve these language models will need less and less data to improve.
- bhouston 4y agoTrue. I think right now ChatGPT doesn't really absorb that much from reading hundreds of cooking books. It sort of does prediction but it doesn't absorb the lessons well and apply them. Honestly, given how much it has read, it is quite stupid in comparison to a human who has read that much, like 1000x stupider. So We should expect significant improvements over the coming years as it starts to really understand what it reads and can reason using that understanding to create additional knowledge that it knows.