4 ms·
Bytes Are All You Need: Transformers Operating Directly on File Bytes
- PaulHoule 2y agoI worked on RNN and CNN models for text a few years back and I really liked the idea of character or byte-based models but it seems that these fasttext-like token encodings won.