4 ms·

Many cloud products now continuously send themselves the input you type while you are typing it, to squeeze the maximum possible amount of data from your intera

by p-e-w 7mo ago

Many cloud products now continuously send themselves the input you type while you are typing it, to squeeze the maximum possible amount of data from your interactions. I don’t know whether ChatGPT is one of those products, but if it is, that behavior might be a side effect of blocking the input pipeline until verification completes. It might be that they want to get every single one of your keystrokes, but only after checking that you’re not a bot.

davidkunz 7mo ago
It's still possible to let users already type from the beginning, just delay sending the characters until checks are complete. Hold them in memory until then.
- miyuru 7mo ago
  Instagram was uploading the images while the user were adding post details, back in 2012! https://news.ycombinator.com/item?id=3913919 https://news.ycombinator.com/item?id=3913919 No one seem to use or care about their own product anymore. Only uses dashboard and metrics, which does not explain the full situation.
  - AlecSchueler 7mo ago
    That makes total sense from a UX perspective though, the ChatGPT thing does not.
    - scottyah 7mo ago
      there were a lot of helpdesk chats doing the same, so you could see users typing messages, then deleting words, etc before hitting send.
  - Imustaskforhelp 7mo ago
    This was actually one of the reasons why Instagram felt smooth. Another thing but Facebook/Instagram have also detected if a person uploads an image and then deletes it and recognizes that they are insecure, and in case of TEENAGE girls, actually then have it as their profile (that they are insecure) and show them beauty products.... I really like telling this example because people in real life/even online get so shocked, I mean they know facebook is bad but they don't know this bad. [Also a bit offtopic, but I really like how the item?id=3913919 the 391 came twice :-) , its a good item id ]
andai 7mo ago
I wondered if ChatGPT streams my message to the GPU while I type it, because the response comes weirdly fast after I submit th message. But I don't know much about how this stuff works.
- aabhay 7mo ago
  Likely prefix caching among many other things
mort96 7mo ago
I just checked the network inspector, the only thing it does per key press is to generate an autocomplete list. It doesn't seem too hard to wait with the autocomplete generation until after whichever checks you run pass.

by p-e-w 7mo ago

davidkunz 7mo ago

It's still possible to let users already type from the beginning, just delay sending the characters until checks are complete. Hold them in memory until then.

miyuru 7mo ago
Instagram was uploading the images while the user were adding post details, back in 2012! https://news.ycombinator.com/item?id=3913919 https://news.ycombinator.com/item?id=3913919 No one seem to use or care about their own product anymore. Only uses dashboard and metrics, which does not explain the full situation.
- AlecSchueler 7mo ago
  That makes total sense from a UX perspective though, the ChatGPT thing does not.
  - scottyah 7mo ago
    there were a lot of helpdesk chats doing the same, so you could see users typing messages, then deleting words, etc before hitting send.
- Imustaskforhelp 7mo ago
  This was actually one of the reasons why Instagram felt smooth. Another thing but Facebook/Instagram have also detected if a person uploads an image and then deletes it and recognizes that they are insecure, and in case of TEENAGE girls, actually then have it as their profile (that they are insecure) and show them beauty products.... I really like telling this example because people in real life/even online get so shocked, I mean they know facebook is bad but they don't know this bad. [Also a bit offtopic, but I really like how the item?id=3913919 the 391 came twice :-) , its a good item id ]

andai 7mo ago

I wondered if ChatGPT streams my message to the GPU while I type it, because the response comes weirdly fast after I submit th message. But I don't know much about how this stuff works.

aabhay 7mo ago
Likely prefix caching among many other things

mort96 7mo ago

I just checked the network inspector, the only thing it does per key press is to generate an autocomplete list. It doesn't seem too hard to wait with the autocomplete generation until after whichever checks you run pass.