3 ms·
> Also, macOS devices are not very good inference solutions They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in
by YetAnotherNick 2y ago
> Also, macOS devices are not very good inference solutions
They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in mac.