2 ms·
LLMs have the massive advantage of low latency. If you have a team on the other side of the clock, you get one cycle a day. With an LLM, you get a cycle every
by sokoloff 1y ago
LLMs have the massive advantage of low latency. If you have a team on the other side of the clock, you get one cycle a day.
With an LLM, you get a cycle every 2-15 minutes. And LLMs are improving faster than outsourcing companies’ employees.
- lazide 1y agoLatency - yes LLM’s are also much better at faking it in remarkably unpredictable ways, and are hitting diminishing returns (or even backsliding) on improvements. And LLM’s can’t actually do anything without humans structuring everything and doing stuff on it’s behalf.