4 ms·
> they will become a superior user interface to almost every thing you want to do No they won't. They're actually a pretty terrible user interface from a desig
by crazygringo 3y ago
> they will become a superior user interface to almost every thing you want to do
No they won't. They're actually a pretty terrible user interface from a design perspective.
Primarily because they provide zero affordances, but also because of speed.
UX is about providing an intuitive understanding of available capabilities at a glance, and allowing you to do things with a single tap that then reflect the new state back to you (confirming the option was selected, confirming the process is now starting).
Where AI is absolutely going to shine is as a helpful assistant in learning/using those interfaces, much as people currently go to Google to ask, "how do I do a hanging indent in Microsoft Word for my Works Cited page"? For one-off things you do infrequently, that's a godsend, don't get me wrong. But it's not going to replace UI, it's going to assist.
And the 99% of your tasks that are repetitive habit will continue to be through traditional UI, because it's so much more efficient. (Not to mention that a lot of the time most people are not in an environment where it's polite or possible to be using a voice interface at all.)
- bratbag 3y agoIf something is a repetitive habit that you can do almost without thinking, there is a good chance an AI could infer that entire chain. I think what's more likely is that an AI based interface will end up being superior after it has had a chance to observe your personal preferences and approach on a conventional UI. So both will still be needed, with an AI helping at the low end and high end of experience and the middle being a training zone as it learns you.
- crazygringo 3y agoI think I wasn't clear enough -- these habits I'm talking about are things like "press cold water button, press start" or "press warm water button, press start" or "tap 'News' app grouping, tap 'NY Times' icon". There's nothing to infer. The sequence is already short. There are no benefits from AI here. But you raise a good point, which is that there are occasionally things like 15-step processes that people repeat a bunch of times, that the AI can observe and then take over. So basically useful in programming macros/shortcuts as well. But that still requires the original UI -- it doesn't replace it.
- JoeAltmaier 3y agoI don't know - the timer app on my oven is trivial too. But I always, always use Alexa to start timers. My hands are busy, so I can just ask "How many minutes left on the tea timer?" Voice is not really clumsy, compared to finding a device, browsing to an app, remembering the interface etc. Already when we meet a new app, we (I) often ask someone to show me around or tell me where the feature is that I want. Not any easier than asking my house AI. Harder really. Hard to underestimate the laziness of humans. I'll get very accustomed to asking my AI to do ordinary things. Already I never poke at the search menu in my TV; I ask Alexa to search for me. So, so much easier. Always available. Never have to spell anything.
- crazygringo 3y agoI think we're basically in agreement though. Everyone agrees setting timers in the kitchen via voice is great precisely because your hands are occupied. It's a special case. (And often used as the example of the only thing people end up consistently using their voice assistant for.) And asking an AI where a feature is in an app -- that's exactly what I was describing. The app still has its UX though. But this is exactly the learning assistance I was describing. And as for searching with Alexa, of course -- but that's just voice dictation instead of typing. Nothing to do with LLM's or interfaces.
- JoeAltmaier 3y agoAlexa's search is a little different - it's context-independent. I can ask for a search from any point in the TV app - in some other menu, while watching another show, heck even when the TV is turned off. And when describing apps - I imagine the AI is an app-free environment, where I just ask those questions of my AI assistant, in lieu of poking at an app at all.
- Workaccount2 3y agoI totally get your point, but I think that AI will allow much "smarter" behavior. Where every appliance is an expert in doing what it is intended to do. So sure, it will still have buttons, but those buttons are really just preset AI prompts on the backend. You can also just talk to your appliance and nuance your request however you want to. A TV with a remote whose channel button just prompts "Next channel" but if you want you would just talk to your TV and say "Skip 10 channels" or "make the channel button do (arbitrary behavior)" The shortcuts will definitely stay, but they will behave closer to "ring bell for service" than "press selection to vend".
- birdyrooster 3y agoLike on Apple Watch Ultra, when I press the start exercise button, the exercises that it suggests are in an order unique to my baseline activities.
- jncfhnb 3y agoNot… “write my works cited page… use hanging indents”?
- cs702 3y agoDon't think it of it as the machine performing repetitive tasks you specify. Think of it instead as the machine accomplishing goals you specify, figuring out on its own the tasks necessary for accomplishing them. Instead of telling the machine something like, say, "increase the left margin by a quarter inch," you'd say something like "I want to create a brochure for this new product idea I just had, and I want the brochure to evoke the difficult-to-describe feeling of a beautiful sunshine. Create 10 brochures like that so I can review them." Instead of telling the machine, say, "add a new column to my spreadsheet between columns C and D," you'd say something like "Attached are three vendor proposals. Please summarize their pros and cons in a spreadsheet, recommend one, and summarize the reasons for your recommendation." All this presumes, of course, that the technology continues to improve at the same pace. No one knows if that will happen.
- wilg 3y agoThere’s no reason chatbots have to be the interface to an LLM. Imagine dynamically generated interfaces redesigning themselves to your needs as you work through a task.
- artursapek 3y agoExactly. Chat is just the first, most general purpose UI. Like a terminal was for computers.
- theK 3y agoAgreed but lets keep in mind that graphical UIs involve significantly more effort than CLIs. In the case where you shoerhorn an ai to be your primary UI I would bet this is as hard if not harder since you typically have to code around significant limitations of current llms
- fragmede 3y agohttp://gitwit.dev http://gitwit.dev shows us that LLMs can generate various GUIs just fine, when prompted.
- theK 3y agoThis is not what I said. Sure you can use such tools or even just classical boilerplate scripts (like we used for a decade now) to get started with react fast. But building out a system that fails well when the underlying llm starts behaving erratically or not at all is a completely different league of engineering as executing a boilerplate script.
- fragmede 3y agoSorry for misinterpreting you. So the underlying LLM starts misbehaving, and the difficulty you see, is that the system as a whole should fail gracefully. What would that look like, in your eyes? A proctor LLM/whatever that observes the output and decides that it has gone awry and decides to take over?
- Veedrac 3y agoAs we all know, the one human skill computers can never replace is doing repetitive tasks quickly.
- thebruce87m 3y agoThis is the Dropbox comment of our time.