4 ms·
We already have that for a while. It works to some degree, but context tokens simply don't offer the level of compression that model weights do. At least with c
by sigmoid10 7mo ago
We already have that for a while. It works to some degree, but context tokens simply don't offer the level of compression that model weights do. At least with current approaches that keep the context human-readable.