3 ms·

I am in the believer camp for simple reasons: 1) we haven’t even scratched the surface of government led investments into AI, 2) AI itself could probably discov

I am in the believer camp for simple reasons: 1) we haven’t even scratched the surface of government led investments into AI, 2) AI itself could probably discover better architectures than transformers (willing to bet heavily on this)

diggan 3y ago
> AI itself could probably discover better architectures than transformers (willing to bet heavily on this) Is there any existing cases of LLMs coming up with novel, useful and namely better architectures? Either related to AI/ML itself or any other field.
jeremyjh 3y ago
> AI itself could probably discover better architectures than transformers The entire subject of the article is concerned with what it will take and how likely it is than an AI will ever will able to generate improvements like this.