2 ms·
How's your experience with 4bit quant ? Does the code output remain decent enough ?
by codexetreme 6mo ago
How's your experience with 4bit quant ? Does the code output remain decent enough ?
- amaitu 6mo agoTBH, still trying it out. Some early tests indicate it's on par with something like Gemini 2 flash.