lukemelas

3 ms·

1. 1.▲
   by lukemelas 3y ago

   Author of the Kalamang paper here. We’ve thought about this a good amount (e.g. there are interesting Mesoamerican scripts), but ultimately we decided to work on low-resource languages, as they’re much more useful. It’s also possible to use
2. 2.▲
   by lukemelas 3y ago

   Author here (of the Kalamang paper). One of my coauthors was the human baseline and he spent many months reading the grammar book (and is incredibly talented at learning languages). It’s really a very high bar.
3. 3.▲
   by lukemelas 4y ago

   Author here. Was not expecting to see this pop up on Hacker News! This was a short write-up of a set of experiments exploring the importance of attention in transformers. I'm glad to see that people are still reading it and hopefully f