4 ms·
Also building something in this space. I think it’s a mistake to compare the speed of LLMs to humans. People don’t like to sit and wait. The more context you ca
by jmathai 2y ago
Also building something in this space. I think it’s a mistake to compare the speed of LLMs to humans. People don’t like to sit and wait. The more context you can give the better but at some point (>30 seconds) people grow tired of waiting.
- mritchie712 2y agoyes, people are used to clicks / actions taking < 200ms, when something takes 20s+, it feels broken even if the results are good.