3 ms·
Tried again with a different quant, UD-Q2_K_XL: https://tools.simonwillison.net/markdown-svg-renderer#url=https%3A%2F%2Fgist.github.com%2Fsimonw%2F6ba7cbfc1a9
by simonw 2mo ago
Tried again with a different quant, UD-Q2_K_XL:
https://tools.simonwillison.net/markdown-svg-renderer#url=https%3A%2F%2Fgist.github.com%2Fsimonw%2F6ba7cbfc1a9336986703b41f7fccd73a https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
- potus_kushner 2mo agothe xhigh version looks amazingly good for a 2 bit quant.
- simonw 2mo ago... and once more with UD-IQ4_XS https://tools.simonwillison.net/markdown-svg-renderer#url=https%3A%2F%2Fgist.github.com%2Fsimonw%2F9bbda2a4acbdbe67bad98289910f8eff https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
- walrus01 2mo agohow does it do with a pelican equipment case?
- qingcharles 2mo agoI guess they haven't benchmaxxed it yet? https://imgur.com/a/vT636BS https://imgur.com/a/vT636BS