4 ms·
Try mradermacher/amoral-gemma3-27B-v2-qat-GGUF
by jychang 2y ago
Try mradermacher/amoral-gemma3-27B-v2-qat-GGUF
- itake 2y agoMy current architecture is an on-device model for fast translation and then replace that with a slow translation (via an API call) when its ready. 24b would be too small to run on device and I'm trying to keep my cloud costs low (meaning I can't afford to host a small 27b 24/7).