4 ms·
Vision models do degrade more with quantization. https://unsloth.ai/blog/dynamic-4bit https://unsloth.ai/blog/dynamic-4bit
by smallerize 1y ago
Vision models do degrade more with quantization. https://unsloth.ai/blog/dynamic-4bit https://unsloth.ai/blog/dynamic-4bit