3 ms·
Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
by danielhanchen 6mo ago
Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!
- ryandrake 6mo agoWill have to try it out. I always thought that was more for fine-tuning and less for inference.
- danielhanchen 6mo agoOh yes sadly we partially mis-communicated haha - there's both and synthetic data generation + exporting!