4 ms·
> seems unfair to compare GPT-6 in a box to a human who is allowed to talk to other humans Are there any efforts to make one gpt talk to another ? Can the olde
by dxbydt 4y ago
> seems unfair to compare GPT-6 in a box to a human who is allowed to talk to other humans
Are there any efforts to make one gpt talk to another ? Can the older versions eg. gpt1 and gpt2, talk to each other, and eventually become more performant than gpt3 ?
- astrange 4y agoProbably not; you could try gluing the models together but it's unlikely it'd improve them and I'm not sure they have the same architecture. Also, even the small/medium GPT3 models are much much worse than the largest one (DaVinci). On the other hand, the lottery ticket hypothesis says that every good big network contains a good or better smaller network you could extract, if only you knew where it was. (So the reason big models are good is there's more opportunities for the smaller models to appear.)