3 ms·
It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.
by ronsor 3y ago
It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.
- ls612 3y agoSo this isn't something anyone without H100s is ever running no matter how you quantize it.