2 ms·
You don't find Image GPT[1] novel? I'm not aware of anything else showing how effective the transformer architecture is on image tasks, and I think that is a p
by nl 6y ago
You don't find Image GPT[1] novel?
I'm not aware of anything else showing how effective the transformer architecture is on image tasks, and I think that is a pretty fundamental breakthrough. I realise it's not GPT-3 (it's based on GPT-2), but this seems more a project resourcing issue than being fundamentally unsatisfying.
[1] https://openai.com/blog/image-gpt/ https://openai.com/blog/image-gpt/