3 ms·
This is a 30B parameter model with 3B active. It should run performantly on a Mac with > 48GB RAM at 8bit precision.
by anon373839 4mo ago
This is a 30B parameter model with 3B active. It should run performantly on a Mac with > 48GB RAM at 8bit precision.
- ltononro 4mo agoWell that is like 3 USD/hour if you run it on a rented gpu