2 ms·
> Yet also, none of the algorithms before Transformers were able to first ingest the web, then answer a random natural language question in any domain — closest
by whimsicalism 3y ago
> Yet also, none of the algorithms before Transformers were able to first ingest the web, then answer a random natural language question in any domain — closest was Google etc. matching on indexed keywords.
Wrong, recurrent models were able to do this, just not as well.