3 ms·
I tried this and installation was easy on macOS 10.14.6 (once I updated Clang correctly). Performance on my relatively old i5-8600 CPU running 6 cores at 3.10G
by dkjaudyeqooe 3y ago
I tried this and installation was easy on macOS 10.14.6 (once I updated Clang correctly).
Performance on my relatively old i5-8600 CPU running 6 cores at 3.10GHz with 32GB of memory gives me about 150-250 ms per token on the default model, which is perfectly usable.