4 ms·
you can't run models that are bigger than 16GB, not comparable.
by john_alan 7mo ago
you can't run models that are bigger than 16GB, not comparable.
- nickthegreek 7mo agosure you can. system ram is will be your limiter here.
- john_alan 7mo agoit's too slow for usable inference though.
- nickthegreek 7mo agoSlow and can’t run are different things, but I get your point.