3 ms·
I run the 32b parameter model also just fine on our 4x H100 rig :) It's good enough for embedding, our use-case.
by rurban 2y ago
I run the 32b parameter model also just fine on our 4x H100 rig :)
It's good enough for embedding, our use-case.
- plaguuuuuu 2y agoI'm not sure if $200k of hardware fits the consumer level