4 ms·
There's a long gh issues thread with technium struggling with Mistral 7 and loss spikes. Easy to find googling.
by bradfox2 3y ago
There's a long gh issues thread with technium struggling with Mistral 7 and loss spikes. Easy to find googling.
- jph00 3y agoYes I'm familiar with Teknium's Mistral issues, which were resolved some time ago. IIRC they weren't related to FSDP.