5 ms·

The Articulation Barrier: Prompt-Driven AI UX Hurts Usability

36 points by iamflimflam1 3y ago

jrm4 3y ago
Relatedly, it's hard to make good music on the piano just using your elbows. Seriously, what is the point they're trying to make here?
- faeriechangling 3y ago
  That adding a prompt interface to a website doesn’t make it accessible for all users, making it inappropriate for UIs which must serve many people, like for instance the public facing UIs that tax agencies or hospitals use. Accessible design is also often mandated by legislation which has existed for many decades before something like ChatGPT existed and old laws have to be interpreted in light of the new technology coming out.
wtftrw 3y ago
The output is in prose too. I don't see how people who can't fundamentally understand the results of a tool should be able to use it.
fardo 3y ago
I think the article's lack of attention to both these interfaces being conversational as well as auto-translating unfortunate, as I think both of these things would suggest on average they may be substantially more accessible than alternative interfaces for the users they're calling out. Admittedly without numbers to bear this out, I've been consistently impressed by the quality of modern text-to-speech audio transcription, and LLMs are, when provided with written dialogue, fairly skilled at replying with usable-to-spectacular results. This suggests a serious potential for improved usability for these low literacy users by expressing their queries as a verbal and untyped stream-of-consciousness by using transcription, while still giving them back well-formed results in response. Additionally, to the extent that this is a problem for non-native speakers separate from native speakers specifically, one of the benefits of LLMs is that they often are capable of generating well-formed inputs in multiple languages trained in their corpus - this suggests that even on an interface designed without localization in mind, Prompt-driven UX can potentially give you user-language localization essentially for free. Given these two points, I don't like the assertion that these kinds of interfaces a priori hurt usability, because they assume a framework of interaction that first doesn't have to be used, and second ignores the users whose usability would potentially be greatly empowered by these kinds of interfaces.
ukuina 3y ago
IIUC: Disambiguous communication skills are essential to successful LLM-driven-development outcomes, but correlate to high literacy skills which are hard to find in most populations.
- faeriechangling 3y ago
  I don’t know how I haven’t thought of this before but my intelligence is skewed verbally and a lot of people on online discussion boards talking about the merits of prompt-driven UIs are going to be skew towards being wordcels. So a lot of the discourse around this technology is probably bias. It’s a good point that I probably should have realized before now. It also makes me think of a few people who I should try to convince to get into prompting…
- cratermoon 3y ago
  > high literacy skills which are hard to find in most populations. Especially because for now the LLMs aren't very good with the native languages of most of the world's population. https://news.ycombinator.com/item?id=39130990 https://news.ycombinator.com/item?id=39130990
kevindamm 3y ago
This article rests on the premise that LLMs require their inputs to be well written. The article points to the existence of prompt engineers to emphasize the difficulty of creating the "right" input. The truth is, these LLMs have already seen the average (and worse) of human writing, and have generalized to a more precise (and typically the intended) input. When they're wrong, they recover pretty well when corrected. The existence of prompt engineers is more for the adaptation and additional context for the mass of thin apps on top of an LLM. I posit that what's needed isn't an abandoning of LLMs as interface, but an acknowledgement that chat-based AI as an input only helps at a certain, rather high, level of abstraction. There are many possible applications that can be built with an LLM but very few that actually enhance the UI of the rest of the app. Application designers need deeper understanding of the LLM's capabilities and the core value of the software product it's intending to enhance in order to build something that is an improvement on what the app would be without an LLM.
- furyofantares 3y ago
  Like gaming with motion controls, where you learn you can just kinda flick your wrists rather than emulate swinging a tennis racket, I've found myself often drastically reducing the number of words I type to get my prompt. For much of the value of LLMs, prompts absolutely do not have to be well written. For some things they do; when I want it to do some programming I'm much clearer. Or if I'm trying to get it to do something it's very bad at (reasoning), but mostly I avoid that.
cratermoon 3y ago
Programmers have known for decades that it's very hard for people to express their requirements in prose, that's one reason why natural-language user interfaces have never lived up to the hype. Ambiguities stump computers. What does "List all employees in the company with a driving license" mean[1]? There's a reason why Prompt Engineer is now a job title: companies need someone able to take someone's half-baked ideas and massage them into something coherent enough to elicit a useful response. 1 https://arxiv.org/abs/cmp-lg/9503016 https://arxiv.org/abs/cmp-lg/9503016
- MisterBastahrd 3y ago
  Ambiguities stump people all the time too. That's why I insist on calling people rather than texting if there's something important I'm attempting to discuss. I don't have the time or emotional energy to attempt to figure out someone's actual mood when discussing something via text.
bloaf 3y ago
Nero was the first Roman Emperor to use a ghost writer for his speeches, and it was considered the death of literacy. To be worthy to wield power over an empire, people said, one ought to be able to organize and express their thoughts. To notice that people can't use a natural language interface because they're bad at organizing and expressing their thoughts, then claim this is a failing of the interface is for the poor craftsmen to blame their tools. To say that we should make language models that are somehow agnostic to a user's command of language is so obviously a fools errand its hard to know where to begin. The author is implicitly calling for mind-reading models.
- dragonwriter 3y ago
  > To notice that people can't use a natural language interface because they're bad at organizing and expressing their thoughts, then claim this is a failing of the interface is for the poor craftsmen to blame their tools. No, its not. The UI is the output of the craft, not the tool of the craftsman. And the blame isn't coming from the craftsman, anyway. It is just as true as the one about craftsmen, if not as popular a saying, that it is a poor toolmaker who blames the people who the tools are made for the tools' unsuitability for their purpose. If a user interface doesn't work for the actual users, it is a poor UI.
  - bloaf 3y ago
    My three points are meant to be taken together. You might say that the toolmaker's job is to make a foolproof tool that does its job completely independently of the user's skill. But my third line denies this possibility in the context of language models.
    - anon373839 3y ago
      If an application is for the general population, it seems there is some empirical evidence that open-ended text interfaces won’t meet those users’ capabilities. So exposing a language model directly to the end user is probably not a good design direction to go in.
- 3y ago
btbuildem 3y ago
It seems to me this article is addressing the wrong problem. If each subsequent generation grows up more ignorant than the last, all the hard won advances of civilization will be lost. People will pray to the few remaining AI terminals like they're deities.
mattlondon 3y ago
I think the article nails it when they talk about requirements docs being useless: people don't know what they want/need. Same in "the old days" of software development, same now with LLMs. It certainly gives me pause for thought - while LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say, I am sure that will improve over the years. But if people cannot even express or articulate what they want (even well-educated, highly-literate people) then I can't see LLMs replacing too many jobs in the near to mid term.
- perryizgr8 3y ago
  > while LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say This is absolutely not true. You should try Bing copilot (or whatever they are calling it this week). It provides extensive citations for everything it asserts. You can easily verify facts by following the hyperlinks. I agree that the original Chatgpt interface is very hard to trust on factual matters due to the lack of citations.
- Falkon1313 3y ago
  >LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say I think this supports the article quite well too. This idea that LLMs 'hallucinate' or that you can't 'trust' them is a clear illustration of the underlying problem. I've never seen an LLM hallucinate or give an untrustworthy response. But I've seen many many people claim that they do. Those people are usually attempting to use a language model to do mathematical calculations, instead of using a calculator. Or to lookup facts, instead of using a database. Or to get an overview of a topic, instead of using an encyclopedia. So naturally, they have about as much luck as someone trying to chop down a tree with a phillips head screwdriver or trying to drive a screw into the wall with a chainsaw. Or even, trying to use a phillips head screwdriver to drive a phillips head screw, but doing so by holding the tip and banging the handle against the screw as if it were a hammer. Too many people aren't using the right tool for the job, and even if they are, they don't know how to use it correctly. That requires some understanding of the tool, some aptitude, and in the case of a language model, some literacy. But these LLMs are being marketed as if they are general purpose artificial intelligences that can do anything, when they're obviously not. And their users don't understand that and aren't using them properly. However, if you use them to pseudorandomly generate natural sounding text, given their training and context, then they absolutely do in fact do that correctly. No 'hallucinations', no 'wrong answers'. They randomly generate natural enough text which fits the topic, pretty much every time. The issue is marketing them as something they're not, to people who aren't literate enough on the topic to know the difference. And if, as the article claims, half the people aren't even literate enough to use them, let alone understand when and how to use them, then it's not a good idea to use them as a standard interface nor to make promises about what they can do, when the people that would be using them wouldn't be able to make them do those things. Back in the day, you pretty much had to be able to understand and program a computer to use one. But imagine if your standard cellphone or laptop nowadays just booted up to a BASIC prompt or even a DOS prompt. Most people would be lost. These days we have UIs such that almost anyone can use them, without that understanding and without having to write their own programs. LLMs are still in that earlier stage. Where you need to understand them to get value out of them. But they're being dolled up and advertised as if you don't. I agree with you, they can't successfully replace jobs when people don't even know what they want or how to use them.
Bjorkbat 3y ago
Kind of reminds me of the "messenger boom" back when Facebook Messenger was new and hot and a bunch of people thought that the "next big thing" was apps that utilize a chat interface. An argument I encountered frequently was that the ultimate interface was a chat-like interface where you asked for what you wanted in natural language and you got it. I thought the hype was well and truly dead until ChatGPT came out and re-animated it. I think we overestimate just how much people like to browse for stuff rather than have it auto-magically done for them or shown to them. When it comes to online shopping, you probably prefer to browse, unless it's a recurring purchase. I still use a search engine for code issues because I prefer browsing for answers vs having one generated for me, usually because I like the additional context that comes from browsing. Outside of browsing, I find it really bizarre that all the generative AI art tools out there use chat interfaces rather than a suite of generative graphics tools, i.e. a generative paintbrush, but then again, most people using said tools aren't trying to create some kind of specific thing in their minds eye, they just want an image. Otherwise, if you wanted to paint a picture, then you'd want either a paintbrush or some kind of paintbrush analogue. Painting a picture through a chat interface just seems kind of ungainly. Kind of an extreme example, but imagine trying to drive a car that has all the familiar controls replaced with a chat interface. Even the A/C is better served by a dial of some sort rather than asking the AI to make the interior a little bit cooler.
DrSiemer 3y ago
Prompting can be compared to writing machine code. Higher level extractions will pop up soon enough, when the core developments slows down a bit. You click the magic button and behind the scenes it automatically adds a bunch of fancy tokens, like "iridescent" or "affluent", that trigger the desired effect.
neilv 3y ago
I suspect improvements will happen pretty quickly, with companies adapting based on looking qualitatively at user behavior, and users figuring out the evolving interfaces. (Maybe even users rapidly learning to express themselves better and more concisely, as a more general skill. Or maybe not: maybe tools like LLMs will teach "bad" habits, like just spamming tokens at a gist of vague intent, and not caring much about the quality, or doing it in a rapid refining loop, without pausing to think and articulate clearly.) Possible precedent: Very early in Google history (it might've still been at Stanford?) a famous HCI person came by my office, and I had Google on my screen. On a tangent, he started editorializing (with the irritation of someone who cares), on how their affordance is just a text box, and people don't know what to type there. My thought at the time (as a mere student) was that the Web search UI was already familiar (Google's was only a bit more all-in on the text box than previously; they mostly just dispensed with the conventional noise on the page), and users and Google would both figure it out. And both did (Google, especially, with smarter responses, based on what they'd learned of intent and information over time). That worked out pretty well for everyone, for a long time.
- squigz 3y ago
  > or doing it in a rapid refining loop, without pausing to think and articulate clearly Like how many people communicate now? :(
morbicer 3y ago
Prompt boxes don't offer much affordances, one of the basic UX concepts https://en.wikipedia.org/wiki/Affordance https://en.wikipedia.org/wiki/Affordance

36 points by iamflimflam1 3y ago

jrm4 3y ago

Relatedly, it's hard to make good music on the piano just using your elbows. Seriously, what is the point they're trying to make here?

faeriechangling 3y ago
That adding a prompt interface to a website doesn’t make it accessible for all users, making it inappropriate for UIs which must serve many people, like for instance the public facing UIs that tax agencies or hospitals use. Accessible design is also often mandated by legislation which has existed for many decades before something like ChatGPT existed and old laws have to be interpreted in light of the new technology coming out.

wtftrw 3y ago

The output is in prose too. I don't see how people who can't fundamentally understand the results of a tool should be able to use it.

fardo 3y ago

I think the article's lack of attention to both these interfaces being conversational as well as auto-translating unfortunate, as I think both of these things would suggest on average they may be substantially more accessible than alternative interfaces for the users they're calling out. Admittedly without numbers to bear this out, I've been consistently impressed by the quality of modern text-to-speech audio transcription, and LLMs are, when provided with written dialogue, fairly skilled at replying with usable-to-spectacular results. This suggests a serious potential for improved usability for these low literacy users by expressing their queries as a verbal and untyped stream-of-consciousness by using transcription, while still giving them back well-formed results in response. Additionally, to the extent that this is a problem for non-native speakers separate from native speakers specifically, one of the benefits of LLMs is that they often are capable of generating well-formed inputs in multiple languages trained in their corpus - this suggests that even on an interface designed without localization in mind, Prompt-driven UX can potentially give you user-language localization essentially for free. Given these two points, I don't like the assertion that these kinds of interfaces a priori hurt usability, because they assume a framework of interaction that first doesn't have to be used, and second ignores the users whose usability would potentially be greatly empowered by these kinds of interfaces.

ukuina 3y ago

IIUC: Disambiguous communication skills are essential to successful LLM-driven-development outcomes, but correlate to high literacy skills which are hard to find in most populations.

faeriechangling 3y ago
I don’t know how I haven’t thought of this before but my intelligence is skewed verbally and a lot of people on online discussion boards talking about the merits of prompt-driven UIs are going to be skew towards being wordcels. So a lot of the discourse around this technology is probably bias. It’s a good point that I probably should have realized before now. It also makes me think of a few people who I should try to convince to get into prompting…
cratermoon 3y ago
> high literacy skills which are hard to find in most populations. Especially because for now the LLMs aren't very good with the native languages of most of the world's population. https://news.ycombinator.com/item?id=39130990 https://news.ycombinator.com/item?id=39130990

kevindamm 3y ago

This article rests on the premise that LLMs require their inputs to be well written. The article points to the existence of prompt engineers to emphasize the difficulty of creating the "right" input. The truth is, these LLMs have already seen the average (and worse) of human writing, and have generalized to a more precise (and typically the intended) input. When they're wrong, they recover pretty well when corrected. The existence of prompt engineers is more for the adaptation and additional context for the mass of thin apps on top of an LLM. I posit that what's needed isn't an abandoning of LLMs as interface, but an acknowledgement that chat-based AI as an input only helps at a certain, rather high, level of abstraction. There are many possible applications that can be built with an LLM but very few that actually enhance the UI of the rest of the app. Application designers need deeper understanding of the LLM's capabilities and the core value of the software product it's intending to enhance in order to build something that is an improvement on what the app would be without an LLM.

furyofantares 3y ago
Like gaming with motion controls, where you learn you can just kinda flick your wrists rather than emulate swinging a tennis racket, I've found myself often drastically reducing the number of words I type to get my prompt. For much of the value of LLMs, prompts absolutely do not have to be well written. For some things they do; when I want it to do some programming I'm much clearer. Or if I'm trying to get it to do something it's very bad at (reasoning), but mostly I avoid that.

cratermoon 3y ago

Programmers have known for decades that it's very hard for people to express their requirements in prose, that's one reason why natural-language user interfaces have never lived up to the hype. Ambiguities stump computers. What does "List all employees in the company with a driving license" mean[1]? There's a reason why Prompt Engineer is now a job title: companies need someone able to take someone's half-baked ideas and massage them into something coherent enough to elicit a useful response. 1 https://arxiv.org/abs/cmp-lg/9503016 https://arxiv.org/abs/cmp-lg/9503016

MisterBastahrd 3y ago
Ambiguities stump people all the time too. That's why I insist on calling people rather than texting if there's something important I'm attempting to discuss. I don't have the time or emotional energy to attempt to figure out someone's actual mood when discussing something via text.

bloaf 3y ago

Nero was the first Roman Emperor to use a ghost writer for his speeches, and it was considered the death of literacy. To be worthy to wield power over an empire, people said, one ought to be able to organize and express their thoughts. To notice that people can't use a natural language interface because they're bad at organizing and expressing their thoughts, then claim this is a failing of the interface is for the poor craftsmen to blame their tools. To say that we should make language models that are somehow agnostic to a user's command of language is so obviously a fools errand its hard to know where to begin. The author is implicitly calling for mind-reading models.

dragonwriter 3y ago
> To notice that people can't use a natural language interface because they're bad at organizing and expressing their thoughts, then claim this is a failing of the interface is for the poor craftsmen to blame their tools. No, its not. The UI is the output of the craft, not the tool of the craftsman. And the blame isn't coming from the craftsman, anyway. It is just as true as the one about craftsmen, if not as popular a saying, that it is a poor toolmaker who blames the people who the tools are made for the tools' unsuitability for their purpose. If a user interface doesn't work for the actual users, it is a poor UI.
- bloaf 3y ago
  My three points are meant to be taken together. You might say that the toolmaker's job is to make a foolproof tool that does its job completely independently of the user's skill. But my third line denies this possibility in the context of language models.
  - anon373839 3y ago
    If an application is for the general population, it seems there is some empirical evidence that open-ended text interfaces won’t meet those users’ capabilities. So exposing a language model directly to the end user is probably not a good design direction to go in.
3y ago

btbuildem 3y ago

It seems to me this article is addressing the wrong problem. If each subsequent generation grows up more ignorant than the last, all the hard won advances of civilization will be lost. People will pray to the few remaining AI terminals like they're deities.

mattlondon 3y ago

I think the article nails it when they talk about requirements docs being useless: people don't know what they want/need. Same in "the old days" of software development, same now with LLMs. It certainly gives me pause for thought - while LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say, I am sure that will improve over the years. But if people cannot even express or articulate what they want (even well-educated, highly-literate people) then I can't see LLMs replacing too many jobs in the near to mid term.

perryizgr8 3y ago
> while LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say This is absolutely not true. You should try Bing copilot (or whatever they are calling it this week). It provides extensive citations for everything it asserts. You can easily verify facts by following the hyperlinks. I agree that the original Chatgpt interface is very hard to trust on factual matters due to the lack of citations.
Falkon1313 3y ago
>LLMs right now are worse than useless due to hallucinations meaning you cannot trust a single thing they say I think this supports the article quite well too. This idea that LLMs 'hallucinate' or that you can't 'trust' them is a clear illustration of the underlying problem. I've never seen an LLM hallucinate or give an untrustworthy response. But I've seen many many people claim that they do. Those people are usually attempting to use a language model to do mathematical calculations, instead of using a calculator. Or to lookup facts, instead of using a database. Or to get an overview of a topic, instead of using an encyclopedia. So naturally, they have about as much luck as someone trying to chop down a tree with a phillips head screwdriver or trying to drive a screw into the wall with a chainsaw. Or even, trying to use a phillips head screwdriver to drive a phillips head screw, but doing so by holding the tip and banging the handle against the screw as if it were a hammer. Too many people aren't using the right tool for the job, and even if they are, they don't know how to use it correctly. That requires some understanding of the tool, some aptitude, and in the case of a language model, some literacy. But these LLMs are being marketed as if they are general purpose artificial intelligences that can do anything, when they're obviously not. And their users don't understand that and aren't using them properly. However, if you use them to pseudorandomly generate natural sounding text, given their training and context, then they absolutely do in fact do that correctly. No 'hallucinations', no 'wrong answers'. They randomly generate natural enough text which fits the topic, pretty much every time. The issue is marketing them as something they're not, to people who aren't literate enough on the topic to know the difference. And if, as the article claims, half the people aren't even literate enough to use them, let alone understand when and how to use them, then it's not a good idea to use them as a standard interface nor to make promises about what they can do, when the people that would be using them wouldn't be able to make them do those things. Back in the day, you pretty much had to be able to understand and program a computer to use one. But imagine if your standard cellphone or laptop nowadays just booted up to a BASIC prompt or even a DOS prompt. Most people would be lost. These days we have UIs such that almost anyone can use them, without that understanding and without having to write their own programs. LLMs are still in that earlier stage. Where you need to understand them to get value out of them. But they're being dolled up and advertised as if you don't. I agree with you, they can't successfully replace jobs when people don't even know what they want or how to use them.

Bjorkbat 3y ago

Kind of reminds me of the "messenger boom" back when Facebook Messenger was new and hot and a bunch of people thought that the "next big thing" was apps that utilize a chat interface. An argument I encountered frequently was that the ultimate interface was a chat-like interface where you asked for what you wanted in natural language and you got it. I thought the hype was well and truly dead until ChatGPT came out and re-animated it. I think we overestimate just how much people like to browse for stuff rather than have it auto-magically done for them or shown to them. When it comes to online shopping, you probably prefer to browse, unless it's a recurring purchase. I still use a search engine for code issues because I prefer browsing for answers vs having one generated for me, usually because I like the additional context that comes from browsing. Outside of browsing, I find it really bizarre that all the generative AI art tools out there use chat interfaces rather than a suite of generative graphics tools, i.e. a generative paintbrush, but then again, most people using said tools aren't trying to create some kind of specific thing in their minds eye, they just want an image. Otherwise, if you wanted to paint a picture, then you'd want either a paintbrush or some kind of paintbrush analogue. Painting a picture through a chat interface just seems kind of ungainly. Kind of an extreme example, but imagine trying to drive a car that has all the familiar controls replaced with a chat interface. Even the A/C is better served by a dial of some sort rather than asking the AI to make the interior a little bit cooler.

DrSiemer 3y ago

Prompting can be compared to writing machine code. Higher level extractions will pop up soon enough, when the core developments slows down a bit. You click the magic button and behind the scenes it automatically adds a bunch of fancy tokens, like "iridescent" or "affluent", that trigger the desired effect.

neilv 3y ago

I suspect improvements will happen pretty quickly, with companies adapting based on looking qualitatively at user behavior, and users figuring out the evolving interfaces. (Maybe even users rapidly learning to express themselves better and more concisely, as a more general skill. Or maybe not: maybe tools like LLMs will teach "bad" habits, like just spamming tokens at a gist of vague intent, and not caring much about the quality, or doing it in a rapid refining loop, without pausing to think and articulate clearly.) Possible precedent: Very early in Google history (it might've still been at Stanford?) a famous HCI person came by my office, and I had Google on my screen. On a tangent, he started editorializing (with the irritation of someone who cares), on how their affordance is just a text box, and people don't know what to type there. My thought at the time (as a mere student) was that the Web search UI was already familiar (Google's was only a bit more all-in on the text box than previously; they mostly just dispensed with the conventional noise on the page), and users and Google would both figure it out. And both did (Google, especially, with smarter responses, based on what they'd learned of intent and information over time). That worked out pretty well for everyone, for a long time.

squigz 3y ago
> or doing it in a rapid refining loop, without pausing to think and articulate clearly Like how many people communicate now? :(

morbicer 3y ago

Prompt boxes don't offer much affordances, one of the basic UX concepts https://en.wikipedia.org/wiki/Affordance https://en.wikipedia.org/wiki/Affordance