2 ms·
I'm currently running dolphin 2.2.1 mistral on an M1 Mac Mini with 16GB of RAM. Zero optimisations, just running base LM Studio, I haven't even bothered with GP
by theshrike79 3y ago
I'm currently running dolphin 2.2.1 mistral on an M1 Mac Mini with 16GB of RAM. Zero optimisations, just running base LM Studio, I haven't even bothered with GPU acceleration.
It thinks about 5-10 seconds before answering and writes the answer about the speed I can read it.
The current top of the line iPads are more powerful than this and an optimised modern iPhone implementation using the ML hardware should be faster than my current setup.