7 ms·
Mosaic's MPT models are already supported in GGML: https://github.com/ggerganov/ggml https://github.com/ggerganov/ggml Here's MPT-30B running in 4-bit precisio
by ml_hardware 3y ago
Mosaic's MPT models are already supported in GGML: https://github.com/ggerganov/ggml https://github.com/ggerganov/ggml
Here's MPT-30B running in 4-bit precision on CPU :) https://twitter.com/abacaj/status/1673133443339763712?s=20 https://twitter.com/abacaj/status/1673133443339763712?s=20
- brucethemoose2 3y agoOh I didn't realize this. Everything is moving so fast that I can't even keep up with the features.