3 ms·
I wonder if we can use transformer models to render text in a compressed form, not human-readable, but which allows other LLMs downstream to work more efficient
by nerdponx 3y ago
I wonder if we can use transformer models to render text in a compressed form, not human-readable, but which allows other LLMs downstream to work more efficiently on the compressed data. The compression can be lossy or fuzzy and it's OK in this case.
- brookst 3y agoIn a way we could look at novels this way — highly compressed semantic data that allows the reader to extrapolate the writer’s vision without including every detail.