5 ms·
Because Google nor any other company is rich enough to use LLMs at that scale. Consider the quality vs. cost per query & latency trade off.
by mrazomor 3y ago
Because Google nor any other company is rich enough to use LLMs at that scale. Consider the quality vs. cost per query & latency trade off.