2 ms·
A bit tangential, but still worth asking since I haven’t seen it addressed anywhere else: When I type a query into Google, it returns results almost instantane
by baxtr 4y ago
A bit tangential, but still worth asking since I haven’t seen it addressed anywhere else:
When I type a query into Google, it returns results almost instantaneously.
With ChatGPT, it has latency PLUS it writes out answers annoyingly slow.
Does anyone know why that spell out every answer like that? Is that a UX gimmick or related to the latency?
- KRAKRISMOTT 4y agoTransformers (the frontend in GPT at least) are autoregressive i.e. they require previous state.