3 ms·

the damn chat.openai.com webapp lags a lot as well on long chats, typing takes so long.

• rsfern 4mo ago
  In my experience the input field lags on short chats too, sometimes in the middle of writing the second or third prompt. Are they running some kind of prospective evaluation or something?
  • nicce 4mo ago
    When you are writing completely new prompt - it sends every character to server when writing and tries to make suggestions based on that. And keeps doing it in intervals in /prepare endpoint, during each prompt. So if you are working with something sensitive - don't write it to browser directly and edit it there.
    • porridgeraisin 4mo ago
      But then why does it become dog slow when the chat becomes bigger?
• lelandfe 4mo ago
  I believe this is because they don’t lazyload the document. The entire conversation sits in the DOM.
  • porridgeraisin 4mo ago
    Yeah - is such a large dom of essentially text expected to be that slow? For what it's worth I use a small script that essentially deletes old chat messages DOM nodes which significantly speeds it up.
    • lelandfe 4mo ago
      Yes, because under the hood it’s much more than just text. It’s not hard to imagine dozens if not hundreds of elements are contained within each prompt+reply pair. I bet there’s also some React performance issues involved here too There are some real table stakes FE perf issues with the ChatGPT site