3 ms·
The 30B one requires 20 GB of memory for me. But some of the lower parameters one should be ok
by UK-Al05 1y ago
The 30B one requires 20 GB of memory for me. But some of the lower parameters one should be ok
- avetiszakharyan 1y agoFor me it was peaking at 35GB even when using