3 ms·
I have not been able to get it working with 2 4090s yet, but I think that's because the library I choose to use (axolotl) does not support model parallel at all
by buildbot 3y ago
I have not been able to get it working with 2 4090s yet, but I think that's because the library I choose to use (axolotl) does not support model parallel at all.
- brucethemoose2 3y agoI wish Facebook would release the raw 34B model... Or better yet, that Mistral would release one.