3 ms·

Sorry but I hate it. Graph->graph transform can describe almost any operation, it's a superset of linear transforms. When all you know about your model is that

Sorry but I hate it. Graph->graph transform can describe almost any operation, it's a superset of linear transforms. When all you know about your model is that 'it's a graph', you barely know anything at all. And transformers are just glorified AST parsers.

cochne 7y ago
> And transformers are just glorified AST parsers. Can you explain this?
- chaitjo 7y ago
  I am guessing he means that Transformers 'discover' parse trees in sentences, as they operate on fully-connected graphs but end up focusing on the most important connections through attention.