3 ms·
> And transformers are just glorified AST parsers. Can you explain this?
by cochne 7y ago
> And transformers are just glorified AST parsers.
Can you explain this?
- chaitjo 7y agoI am guessing he means that Transformers 'discover' parse trees in sentences, as they operate on fully-connected graphs but end up focusing on the most important connections through attention.