6 ms·

It is interesting that most of our modes of interaction with AI is still just textboxes. The only big UX change in that the last three years has been the introd

It is interesting that most of our modes of interaction with AI is still just textboxes. The only big UX change in that the last three years has been the introduction of the Claude Code / OpenAI Codex tools. They feel amazing to use, like you're working with another independent mind. I am curious what the user interfaces of AI in the future will be, I think whoever can crack that will create immense value.

empath75 11mo ago
ChatGPT's voice is absolutely amazing and I prefer it to text for brainstorming.
- deleted 11mo ago
  [deleted]
- vessenes 11mo ago
  Ooooh, it bothers me, so, so, so much. Too perky. Weirdly casual. Also, it's based on the old 4o code - sycophancy and higher hallucinations - watch out. That said, I too love the omni models, especially when they're not nerfed. (Try asking for a Boston, New York, Parisian, Haitian, Indian and Japanese accent from 4o to explore one of the many nerfs they've done since launch)
  - wmeredith 11mo ago
    I think the commenter you're replying to was talking about dictating to ChatGPT, which I also find extremely useful.
visioninmyblood 11mo ago
I agree i think specifically the world is multi modal. Getting a chat to be truly multi modal .i.e interacting with different data types and text in an unified way is going to be the next big thing. Mainly given how robotics is taking off 3d might be another important aspect to it. At vlm.run we are trying to make this possible how to combine VLM's and LLM's in a seem less way to get the best UI. https://chat.vlm.run/c/3fcd6b33-266f-4796-9d10-cfc152e945b7 https://chat.vlm.run/c/3fcd6b33-266f-4796-9d10-cfc152e945b7
Herring 11mo ago
Text is very information-dense. I'd much rather skim a transcript in a few seconds than watch a video. There's a reason keyboards haven't changed much since the 1860s when typewriters were invented. We keep coming up with other fun UI like touchscreens and VR, but pretty much all real work happens on boring old keyboards.
- srmatto 11mo ago
  Here's an old blog post that explores that topic at least with one specific example: https://www.loper-os.org/?p=861 https://www.loper-os.org/?p=861 The gist is that keyboards are optimized for ease of use but that there could be other designs which would be harder to learn but might be more efficient.
  - AdieuToLogic 11mo ago
    >> There's a reason keyboards haven't changed much since the 1860s when typewriters were invented. > The gist is that keyboards are optimized for ease of use but that there could be other designs which would be harder to learn but might be more efficient. Here's a relevant trivia question; assuming a person has two hands with five digits each, what is the largest number they can count to using only same? Answer: (2 ** 10) - 1 = 1023 Ignoring keyboard layout options (such as QWERTY vs DVORAK), IMHO keyboards have the potential for capturing thought faster and with a higher degree of accuracy than other forms of input. For example, it is common for touch-typists to be able to produce 60 - 70 words per minute, for any definition of word. Modern keyboard input efficiency can be correlated to the ability to choose between dozens of glyphs with one or two finger combinations, typically requiring less than 2cm of movement to produce each.
    - lifthrasiir 11mo ago
      Only if individual digits can be articulated separately from each other. Human anatomy limits what is actually possible. Also synchronization is a big problem in chorded typing; good typists can type more than 10 strokes per second, but no one can type 10 chords (synchronous sets of strokes) per seconds I think.
timschmidt 11mo ago
Unix CLI utilities have been all text for 50 years. Arguably that is why they are still relevant. Attempts to impose structured data on the paradigm like those in PowerShell have their adherents and can be powerful, but fail when the data doesn't fit the structure. We see similar tendency toward the most general interfaces in "operator mode" and similar the-AI-uses-the-mouse-and-keyboard schemes. It's entirely possible for every application to provide a dedicated interface for AI use, but it turns out to be more powerful to teach the AI to understand the interfaces humans already use.
- oblio 11mo ago
  Yet the most popular platforms on the planet have people pointing a finger (or several) at a picture. And the most popular media format on the planet is and will be (for the foreseeable future), video. Video is only limited by our capacity to produce enough of it at a decent quality, otherwise humanity is definitely not looking back fondly at BBSes and internet forums (and I say this as someone who loves forums). GenAI will definitely need better UIs for the kind of universal adoption (think smartphone - 8/9 billion people).
  - Vegenoid 11mo ago
    > Video is only limited by our capacity to produce enough of it at a decent quality, otherwise humanity is definitely not looking back fondly at BBSes and internet forums Video is limited by playback speed. It is a time-dependent format. Efforts can be made to enable video to be viewable at a range of speeds, but they are always somewhat constrained. Controlling video playback to slow down and rewatch certain parts is just not as nice as dealing with the same thing in text (or static images), where it’s much easier to linger and closely inspect parts that you care more about or are struggling to understand. Likewise, it’s easier to skim text than video. This is why many people prefer transcripts, or articles, or books over videos. I seriously doubt that people would want to switch text-based forums to video if only video were easier to make. People enjoy writing for the way it inspires a different kind of communication and thought. People like text so much that they write in journals that nobody will ever see, just because it helps them organize their thoughts.
jstummbillig 11mo ago
People get a little too hung up on finding the AI UI. It does not seem all necessary that the interfaces will be much different (while the underlying tech certainly will be). Text and boxes and tables and graphs is what we can cope with. And while the AI is going to change much, we are not.
remir 11mo ago
Grok has been integrated into Tesla vehicles, and I've had several voice interactions with it recently. Initially, I thought it was just a gimmick, but the voice interactions are great and quite responsive. I've found myself using it multiple times to get updates on the news or quick questions about topics I'm interested in.
joegibbs 11mo ago
When we have really fast and good models it will be able to generate a GUI on the fly. It could probably be done now with a fine-tune on some kind of XML-based UI schema or something. I gave it a try but couldn't figure it out entirely, consistency would be an issue too.
- in-silico 11mo ago
  Google is already doing this with Gemini: https://research.google/blog/generative-ui-a-rich-custom-visual-interactive-user-experience-for-any-prompt/ https://research.google/blog/generative-ui-a-rich-custom-vis... I don't know if/when it will actually be in consumers hands, but the tech is there.
whoamii 11mo ago
[dead]
in-silico 11mo ago
The next step (and I am not claiming it's the right one) is probably "Generative UI" where the model creates website-like interfaces on the fly. Google seems to be making good progress [1] and it seems like only a matter of time before it reaches consumers. 1. https://research.google/blog/generative-ui-a-rich-custom-visual-interactive-user-experience-for-any-prompt/ https://research.google/blog/generative-ui-a-rich-custom-vis...
michaelanckaert 11mo ago
Personally I find the information density of text to be the "killer feature". I've tried voice interaction (even built some AI Voice Agents) and while they are very powerful, easy to use and just plain cool, they are also slow. Nothing beats skimming over a generated text response and just picking out chunks of text, going back and forth, rereading, etc. Text is also universal, I can't copy-paste a voice response to another application/interface or iterate over it. My personal view is that the search for a better AI User Interface is just the further dumbing down of the humans who use these interface. Another comment mentioned that the most popular platforms are people pointing fingers at pictures and without a similar UI/UX AI would never reach such adoption rates, but is that what we want? Monkeys pointing at colorful picture blobs?
Ancapistani 11mo ago
I get what you’re saying here, and you’re right that other UIs will be a big deal in the near future… but I don’t think it’s fair to say “just” textboxes. This is HN. A lot of us work remotely. Speaking for myself, I much prefer to communicate via Slack (“just a textbox”) over jumping into a video call. This is especially true with technical topics, as text is both more dense and far more clear than speech in almost all cases.
hermitShell 11mo ago
If you are interested in UX a youtube series I found enjoyable and thought provoking is "liber indigo" (sorry, on mobile) What comes after the desktop metaphor and mobile? There is VR but... no one is sure it will get anywhere. It's cool but probably won't supplant tradition. Maybe the ability of AI to accept somewhat imprecise inputs will help us get away from text. Multimodal gesture, voice, and touch perhaps?. So we would all be sort of body acting like players on a stage, in order to convey to a machine what direction you wish to turn its attention

empath75 11mo ago

ChatGPT's voice is absolutely amazing and I prefer it to text for brainstorming.

deleted 11mo ago
[deleted]
vessenes 11mo ago
Ooooh, it bothers me, so, so, so much. Too perky. Weirdly casual. Also, it's based on the old 4o code - sycophancy and higher hallucinations - watch out. That said, I too love the omni models, especially when they're not nerfed. (Try asking for a Boston, New York, Parisian, Haitian, Indian and Japanese accent from 4o to explore one of the many nerfs they've done since launch)
- wmeredith 11mo ago
  I think the commenter you're replying to was talking about dictating to ChatGPT, which I also find extremely useful.

visioninmyblood 11mo ago

I agree i think specifically the world is multi modal. Getting a chat to be truly multi modal .i.e interacting with different data types and text in an unified way is going to be the next big thing. Mainly given how robotics is taking off 3d might be another important aspect to it. At vlm.run we are trying to make this possible how to combine VLM's and LLM's in a seem less way to get the best UI. https://chat.vlm.run/c/3fcd6b33-266f-4796-9d10-cfc152e945b7 https://chat.vlm.run/c/3fcd6b33-266f-4796-9d10-cfc152e945b7

Herring 11mo ago

Text is very information-dense. I'd much rather skim a transcript in a few seconds than watch a video. There's a reason keyboards haven't changed much since the 1860s when typewriters were invented. We keep coming up with other fun UI like touchscreens and VR, but pretty much all real work happens on boring old keyboards.

srmatto 11mo ago
Here's an old blog post that explores that topic at least with one specific example: https://www.loper-os.org/?p=861 https://www.loper-os.org/?p=861 The gist is that keyboards are optimized for ease of use but that there could be other designs which would be harder to learn but might be more efficient.
- AdieuToLogic 11mo ago
  >> There's a reason keyboards haven't changed much since the 1860s when typewriters were invented. > The gist is that keyboards are optimized for ease of use but that there could be other designs which would be harder to learn but might be more efficient. Here's a relevant trivia question; assuming a person has two hands with five digits each, what is the largest number they can count to using only same? Answer: (2 ** 10) - 1 = 1023 Ignoring keyboard layout options (such as QWERTY vs DVORAK), IMHO keyboards have the potential for capturing thought faster and with a higher degree of accuracy than other forms of input. For example, it is common for touch-typists to be able to produce 60 - 70 words per minute, for any definition of word. Modern keyboard input efficiency can be correlated to the ability to choose between dozens of glyphs with one or two finger combinations, typically requiring less than 2cm of movement to produce each.
  - lifthrasiir 11mo ago
    Only if individual digits can be articulated separately from each other. Human anatomy limits what is actually possible. Also synchronization is a big problem in chorded typing; good typists can type more than 10 strokes per second, but no one can type 10 chords (synchronous sets of strokes) per seconds I think.

timschmidt 11mo ago

Unix CLI utilities have been all text for 50 years. Arguably that is why they are still relevant. Attempts to impose structured data on the paradigm like those in PowerShell have their adherents and can be powerful, but fail when the data doesn't fit the structure. We see similar tendency toward the most general interfaces in "operator mode" and similar the-AI-uses-the-mouse-and-keyboard schemes. It's entirely possible for every application to provide a dedicated interface for AI use, but it turns out to be more powerful to teach the AI to understand the interfaces humans already use.

oblio 11mo ago
Yet the most popular platforms on the planet have people pointing a finger (or several) at a picture. And the most popular media format on the planet is and will be (for the foreseeable future), video. Video is only limited by our capacity to produce enough of it at a decent quality, otherwise humanity is definitely not looking back fondly at BBSes and internet forums (and I say this as someone who loves forums). GenAI will definitely need better UIs for the kind of universal adoption (think smartphone - 8/9 billion people).
- Vegenoid 11mo ago
  > Video is only limited by our capacity to produce enough of it at a decent quality, otherwise humanity is definitely not looking back fondly at BBSes and internet forums Video is limited by playback speed. It is a time-dependent format. Efforts can be made to enable video to be viewable at a range of speeds, but they are always somewhat constrained. Controlling video playback to slow down and rewatch certain parts is just not as nice as dealing with the same thing in text (or static images), where it’s much easier to linger and closely inspect parts that you care more about or are struggling to understand. Likewise, it’s easier to skim text than video. This is why many people prefer transcripts, or articles, or books over videos. I seriously doubt that people would want to switch text-based forums to video if only video were easier to make. People enjoy writing for the way it inspires a different kind of communication and thought. People like text so much that they write in journals that nobody will ever see, just because it helps them organize their thoughts.

jstummbillig 11mo ago

People get a little too hung up on finding the AI UI. It does not seem all necessary that the interfaces will be much different (while the underlying tech certainly will be). Text and boxes and tables and graphs is what we can cope with. And while the AI is going to change much, we are not.

remir 11mo ago

Grok has been integrated into Tesla vehicles, and I've had several voice interactions with it recently. Initially, I thought it was just a gimmick, but the voice interactions are great and quite responsive. I've found myself using it multiple times to get updates on the news or quick questions about topics I'm interested in.

joegibbs 11mo ago

When we have really fast and good models it will be able to generate a GUI on the fly. It could probably be done now with a fine-tune on some kind of XML-based UI schema or something. I gave it a try but couldn't figure it out entirely, consistency would be an issue too.

in-silico 11mo ago
Google is already doing this with Gemini: https://research.google/blog/generative-ui-a-rich-custom-visual-interactive-user-experience-for-any-prompt/ https://research.google/blog/generative-ui-a-rich-custom-vis... I don't know if/when it will actually be in consumers hands, but the tech is there.

whoamii 11mo ago

[dead]

in-silico 11mo ago

The next step (and I am not claiming it's the right one) is probably "Generative UI" where the model creates website-like interfaces on the fly. Google seems to be making good progress [1] and it seems like only a matter of time before it reaches consumers. 1. https://research.google/blog/generative-ui-a-rich-custom-visual-interactive-user-experience-for-any-prompt/ https://research.google/blog/generative-ui-a-rich-custom-vis...

michaelanckaert 11mo ago

Personally I find the information density of text to be the "killer feature". I've tried voice interaction (even built some AI Voice Agents) and while they are very powerful, easy to use and just plain cool, they are also slow. Nothing beats skimming over a generated text response and just picking out chunks of text, going back and forth, rereading, etc. Text is also universal, I can't copy-paste a voice response to another application/interface or iterate over it. My personal view is that the search for a better AI User Interface is just the further dumbing down of the humans who use these interface. Another comment mentioned that the most popular platforms are people pointing fingers at pictures and without a similar UI/UX AI would never reach such adoption rates, but is that what we want? Monkeys pointing at colorful picture blobs?

Ancapistani 11mo ago

I get what you’re saying here, and you’re right that other UIs will be a big deal in the near future… but I don’t think it’s fair to say “just” textboxes. This is HN. A lot of us work remotely. Speaking for myself, I much prefer to communicate via Slack (“just a textbox”) over jumping into a video call. This is especially true with technical topics, as text is both more dense and far more clear than speech in almost all cases.

hermitShell 11mo ago

If you are interested in UX a youtube series I found enjoyable and thought provoking is "liber indigo" (sorry, on mobile) What comes after the desktop metaphor and mobile? There is VR but... no one is sure it will get anywhere. It's cool but probably won't supplant tradition. Maybe the ability of AI to accept somewhat imprecise inputs will help us get away from text. Multimodal gesture, voice, and touch perhaps?. So we would all be sort of body acting like players on a stage, in order to convey to a machine what direction you wish to turn its attention