4 ms·
LLM latency has also gone down 10-100x in the last 5 years. Back then, you could only give it a few sentences, now it's like $10 for 10 novels worth of text.
by muzani 2y ago
LLM latency has also gone down 10-100x in the last 5 years. Back then, you could only give it a few sentences, now it's like $10 for 10 novels worth of text.