3 ms·
If you have to fetch one or more dictionaries to decompress the file anyway, why not just include the dictionary with the file you need to decompress?
by bastawhiz 3y ago
If you have to fetch one or more dictionaries to decompress the file anyway, why not just include the dictionary with the file you need to decompress?
- jmoss20 3y agoBecause the model (=="dictionary") is 70B floats -- 280GB naively, 40-70GB aggressively quantized (which might reduce compression rate). If your file is big enough that the marginal compression win over other methods makes this space-effective, sure. But that's a very narrow case.