3 ms·
That suggests that 16GB RAM will not be enough. In fact, like it appears in the reports above, it is "7b" as in > 7B parameters in its visual generation compo
by mdp2021 6d ago
That suggests that 16GB RAM will not be enough.
In fact, like it appears in the reports above, it is "7b" as in
> 7B parameters in its visual generation component
It seems they calibrated the size to fill a 16GB VRAM near the limit. RAM requirements will vary.