3 ms·
By being simple does not mean that it is not insightful
by kroggen 6y ago
By being simple does not mean that it is not insightful
- dave_sullivan 6y agoI’m not seeing anything insightful though. They are taking a fairly standard architecture, claiming it’s something different, and then claiming some connection to biological neurons. As I read it, this is an example of people publishing a minor tweak in the algorithm and then claiming it’s a new biologically inspired abstraction. I guess I just want more papers about transformers.