5 ms·
Nobody really knows how to product-ize any of these LLM interfaces beyond just chat. They don't want a traditional UI with buttons and forms and labels because
by petcat 17d ago
Nobody really knows how to product-ize any of these LLM interfaces beyond just chat.
They don't want a traditional UI with buttons and forms and labels because they want the interface to be "chat". The problem is that "chat" is tedious. And the turn-based, linear nature of the chat interaction model makes it even more tedious and unproductive.
- threwaway555999 17d ago[dead]
- jeromechoo 17d agoThis has been my ongoing gripe. Someone put chat in front of a transformer model. It exploded like all prior versions of “AI chat” did. Now what? The moment someone figures out a new modality for LLMs is when we’ll see the next hockey stick.
- dsign 17d ago> The moment someone figures out a new modality for LLMs is when we’ll see the next hockey stick. Honestly, that fills me with fear. LLMs exist to make money to their companies, and said companies are not gonna turn around and say, "you know what, go are going to make an android for each elderly person, that can not only help them with their medications, but that can actually make their medications, tailored to their biologies." Instead, they are going to go for the low-handing fruit of "you know Bob, the guy who makes jokes in meetings but who is grumpy about delivery timelines? Well, we are going to make an android to replace Bob. MetalBob will make even better jokes. The blue model will be able to explain in excruciating level of detail why timelines aren't reasonable. The red model will walk through the cubicles with a whip to ensure everybody keeps working all the time, and nobody goes to pee."
- dpkirchner 17d agoPerhaps we could see a Yahoo Pipes style interface and feature set, handled by LLM (when simple transforms aren't an option).
- varispeed 17d agoDo you know that you can have multiple chats at the same time?
- petcat 17d agoDoubling the tediousness does not solve the interface problem.
- fidotron 17d agoThe great confusion for Anthropic and OAI is how to break out from pure chat without signalling you in fact intend to eat all of your customer's business too.
- clumsysmurf 17d agoOne thing I would like is a tree-like chat structure like reddit / HN. Many times I abandon the direction things have gone but would like to resume at some ancestor or sibling response.
- BikiniPrince 17d agoI solved this with task management and got work trees. The downside of course is branching in got, but I usually don’t go of course more then a handful of tasks. I had to engineer my own ticket management to keep opus on target. It’s been great for managing work, history, audit trails and commits are tagged with the task id. I implemented subtasks to deal with the way Claude likes to stage its own objectives. Then I made enforcement logic in the task manager so tasks can’t be closed out until reviewers have consensus on the same sha. The adhd that is Anthropic demanded I build it and now I’m knocking out issues faster than Batman.
- drivebyhooting 17d agoYes this would be very useful. Or at least being able to selectively compact a linear part and continue from before. Often times I just sort of wish to undo.
- whythismatters 17d agoI'm not affiliated, and did not actually try it, but your comment reminded me of the juggler coding agent, discussed here: https://news.ycombinator.com/item?id=48883305 https://news.ycombinator.com/item?id=48883305 >Each conversation is a Yjs CRDT tree. It can branch into sub-threads (recursively), and you can drill down, backtrack, edit, undo/redo, and inspect everything: tool calls, approvals, and the raw context JSON going to the model, etc.
- jobigoud 17d agoYou can do that right now in ChatGPT? Every answer has a "Branch in new chat" button. You can go back to any point and branch again.
- adrianmonk 17d agoGemini has something kind of like this. In a chat, click on the "..." icon next to one of Gemini's responses and select "Branch in new chat". It creates a new chat which has the conversation up to that point and a link to the conversation you branched it from. The UI isn't tree-like, though. It's more like Git where each branch name is just mixed in with the rest of the soup of references.
- jonathanberger 17d agoI don't think it's that anyone wants the interface to be chat. I think it's that the underlying technology is inherently words in and words out. It's similar to how devices with capacitive screens are most naturally going to support tapping, dragging, and pinching.
- sroerick 17d agoIt's funny to me that instead of moving existing tech to a word in word out paradigm, people are dropping millions getting the chat to work with the existing paradigm. Probably inevitable, but seems like a lot of disruption could happen there.
- nonethewiser 17d agoText based workflows are king
- gessha 17d agoI mean, that's the first adoption phase where you don't start from scratch but keep using the old tech with the bolted on LLMs. It would take some time for devs to build the primitives around the new tech.
- dvt 17d agoMy personal hot take is that the product people (engineers too probably) at these companies are just straight up lazy. Yes, a new UI paradigm is hard, but it's been painfully obvious that chat just absolutely sucks. It's also obvious that some DSL-ish thing is possible, something that just does token juggling and the end-user sees some UI behavior. I know this all sounds abstract. I've been mulling over it for the past year and it's very hard; and LLMs are super janky and inconsistent so it's 100% not trivial. So in some sense I understand why a lazy bottom-of-the-barrel "chat interface" has become the de facto standard.
- nonethewiser 17d agoCan you elaborate? How in the world would I interface with claude other than sending it messages?
- yieldcrv 17d agoBefore OpenAI dropped ChatGPT, nobody knew chat would be such a hit. Several labs had versions of these things, Google engineers were getting finessed by a rudimentary model just like in the movie Ex Machina that came out 10 years prior which was satirizing Google But I don't agree that they aren't product-ized. There are many applications doing calls to LLMs behind the scenes and are hits, leveraging structured data very heavily and not having conversations with users at all. I would say that there is a predictable scope creep from executives to surface a conversational aspect though. We need to bring representation to that so we can point to some other best practice to push back
- drivebyhooting 17d agoCan you give examples of wrapped LLM logic? API calls are expensive and slow, so I’ve shied away from integrating them into my personal projects. And of course there’s always the risk of hallucination.
- disgruntledphd2 17d agoFor converting unstructured data into (more) structured data, they're phenomenal. Yes, they are expensive, but flexibility has a lot of value.
- yieldcrv 17d agoThe keyboard in iOS since 18
- emadabdulrahim 17d agoIMO no one knows what LLMs are capable of yet and the goal post keeping moving every few months that building any specific UIs right now risks rendering them obsolete or too slow. e.g. We went from somewhat smarter code autocomplete, to asking chatgpt copy paste, to cli agent running inside your project, managing session, to GUI to manage that, to projects where you talk to a "Chief of Staff" agent that manages other sessions, to who knows what's next. I think the right interfaces for LLMs right now need to be very simple and easy to change/evolve. And chat still seems to be the best default solution.
- doublerabbit 17d agoWe have all that? I'm still copying and pasting off the WebUI of ChatGPT. Traditional and boring works for me.
- cruffle_duffle 17d ago"Traditional and boring works for me." I wouldn't call copy & paste code from a webui of chatgpt either traditional or boring. I'd call it tedious, error prone and guaranteed to get poor results. There is much better tooling and harnesses to leverage now.
- eieiei1 17d agoIt’s not surprising. Technology folks don’t really understand people and what they need. This always happens. This is why woz needed Steve. Steve Jobs is sorely missed tbh. For all the shit he got - he was a true visionary. He lived at the intersection of technology and the humanities… he kept preaching this. And now we are seeing why.
- frnz 17d agoThis is so true, it really struck me, thanks. For me, this is the most important post of the week. By far.
- drivebyhooting 17d agoChat is only tedious because it’s slow. If models responded in 300ms it would be the ideal interface.
- jamiegregz 17d agoWe’re working on this problem at my company. All of our competitors have churned out a bunch of generic chat based agents (basic harness with a few tools connected and different system prompts) to do basic stuff you’d used to do from a wizard or even just a couple of buttons in a form. We’re steering away from this by building full ‘surface’ agents with A2UI and an initial surface message. The users just see a normal looking web application but under the hood it’s all driven by a harness. UI updates are effectively just new events received by the client. Events are either generated by an LLM directly, or deterministically - it’s up to the dev.
- paulhebert 17d agoWhy would I want that for a form with buttons? It sounds painful to debug
- tencentshill 17d ago"Chat" makes it feel more like you're talking to a human. They need people to believe AGI is imminent when using the product.