3 ms·
For your setup, do you have both 3090's in parallel for the inference of the model?
by venusenvy47 2mo ago
For your setup, do you have both 3090's in parallel for the inference of the model?
- swalsh 2mo agoYes they run in parallel via LMStudio (250k context)