2 ms·
The key takeaway for me: Whether data is continuous or discrete, no matter its modality (text, video, music, etc.), we now have an array of proven methods for
by cs702 3y ago
The key takeaway for me:
Whether data is continuous or discrete, no matter its modality (text, video, music, etc.), we now have an array of proven methods for representing it with discrete tokens, enabling us to use existing sequence modeling architectures (Transformers, linear RNNs).
We live in interesting times!
- aaron_wang 3y agoTotally agree. Another takeaway is that data from different modality has some shared intrinisity, so one can be mapped to another.