4 ms·
Ask HN: Why are LLM UIs so slow?
I love Claude Sonnet but the user interface is super slow. After chatting sometime, it becomes too slow and its even hard to scroll.
To counter this, I tried Openrouter's chat interface, but that is painfully slow. I'm trying now Gemini 2.5 in Google AI studio and it is also slow.
What is the underlying reason for this? I understand the backend takes a lot of computation, but frontend?
- lukejkwarren 2y agoIt's the big bummer with reasoning models, although they are improving a lot. I experimented with various reasoning models for my AI security scanner product but found the performance to just be far too slow.
- rishikeshs 2y agoBut is it a front end issue? I can understand the time taking to process, but the whole tab becomes unusable after a while!
- squircle 2y agoI think it's both. If you look at the response coming back from claude you can get an idea for how the front end library probably works. (When updating an artifact, claude's response is inefficient. Perhaps this is more reliable at scale but... why not use a diff format similar to git?)
- cheevly 2y agoYeah sounds like a lack of ‘virtual scrolling’. Behind these scenes, they are often creating a tremendous number of markdown renderer components, which are expensive and not meant to have hundreds of instances on a page. It’s a tricky problem imo, and involves tradeoffs with the scrollbar ergonomics.