3 ms·
Lovely, yoinked. Also, I’m seeing check marks next to all quants which confused me a little bit when trying to select.
by ndgold 11mo ago
Lovely, yoinked.
Also, I’m seeing check marks next to all quants which confused me a little bit when trying to select.
- hertzdog 11mo agoThanks! I added the check marks because when I was testing different quantizations, I often picked a model and only afterwards discovered that it couldn’t even load — it just didn’t fit into RAM or VRAM. So the check mark simply indicates that the model can actually run under those constraints (fits in memory), not that it’s selected.