3 ms·
That's completely different scale. You're not going to run GPT4 like a random ollama model. At that point you need dedicated external hardware for the service,
by viraptor 3y ago
That's completely different scale. You're not going to run GPT4 like a random ollama model. At that point you need dedicated external hardware for the service, and proper batching/pipelining to utilise it well. This is way out of the "enough ram in the laptop area".