9 ms·
Generative AI is also a revolution for computer interfaces
- meghan_rain 3y ago> what is discoverability
- smy20011 3y agoI don't think so. Chat based interface is horrible on phone. You have to type what you want instead of tapping things. Chatbot should be part of your ui instead of replacing the ui.
- selalipop 3y agoI hear this often, but you don't need to surface the output of an LLM as chat I made https://notionsmith.ai https://notionsmith.ai and technically it's "chat based", but the user isn't exposed to 99% of the chatting: the only chat interface on the site is there more as a bonus feature than anything.
- cj 3y agoI agree your app shouldn’t be labeled 100% a chat bot, but the primary method of interacting with it is via natural language, which is the fundamental difference the article is describing.
- CharlesW 3y ago> You have to type what you want instead of tapping things. On phones, I'd expect that voice will be a more popular input method than virtual keyboards.
- malfist 3y agoThat works in isolation, but not when you're not home. Do you want to talk to your phone in a public restroom, or the subway, or in the office?
- deleted 3y ago[deleted]
- CharlesW 3y agoFrom what I've observed, people have no problem talking to other people in public places. I don't see why this behavior would change for non-human listeners. I regularly use speech-to-text transcription publicly. With my mouth close to the mic, I can speak softly enough that people outside of my personal space can't hear. That being said, keyboards still have their place. Certainly, I use ChatGPT on my phone several times a week using keyboard input, and it's not particularly onerous.
- Aeolun 3y agoPersonally I’m mildly disturbed at the legion of people currently staring at and tapping at their phones suddenly switching to muttering at them.
- coldcode 3y agoOnce your chat voice listener can access your private information like bank accounts, etc., I imagine things will listen to you everywhere. Perhaps every phone or device will be listening like Find My Devices except being Take My Money.
- Sophira 3y agoPeople do that already. It's just that when they do so it's normally a phone call. There's no reason people couldn't make interfaces that use the same speaker as a phone call does.
- ChatGTP 3y agoIt’s not really convenient in many situations.
- basch 3y agoMaybe instead of a keyboard of letters there is an array of words to build commands from.
- mortenjorck 3y ago> Think of the hours saved — and, in theory, productivity gained — if you can simply tell your chatbot to clean up your inbox, change your system settings or connect to a printer. I have a difficult time imagining myself trusting something as unpredictable as an LLM to perform any kind of "cleaning up" task on important data like my inbox. Perhaps future developments in utilizing language models in conjunction with less stochastic systems will make this an easier sell, but for now, I'm not seeing it.
- madrox 3y agoAs someone who's been working on this space as their day job for the last several months, I can say that LLMs are SURPRISINGLY GOOD at this. The real challenge is the sentiment you're articulating here...trust. I've been relating it to self-driving cars. I love the idea, but I'm going to be very anxious the first several times I climb into one to take me somewhere at freeway speeds. The biggest UX work in the short term is going to be around giving people the right amount of transparency so they still feel in control. The actual LLM work is relatively easy and impressive.
- moffkalast 3y agoHow can you get transparency from an LLM? They're complete black boxes by architecture.
- AussieWog93 3y ago>How can you get transparency from an LLM? They're complete black boxes by architecture. You just ask them. I literally just prompted ChatGPT (3.5) to think about its answer again and explain what's wrong with it, and it did. Kept going 2 or 3 times, until it was sure it wasn't doing anything wrong, and magically the script it produced at that stage just worked.
- a_bonobo 3y agoBut can you believe that these are the correct explanations? Perhaps it just confabulated an explanation that sounds likely given your prompt, and is not the actual reason it told you what it did?
- jonplackett 3y agoThis doesn’t have to be for complex or really critical tasks to have value. Just having it able to work a smart home or do basic things while talking natural is a big deal and a big increase in useful interface. I really like my Alexa - I love the _idea_ of a conversation interface, except an Alexa isn’t that. It’s a call and response only. I’d love to be able to talk to a computer out loud conversationally that can take actions / give me info. Even convos as simple as ‘Hey what’s the weather tomorrow’ ‘Tomorrow will be 25c and raining’ ‘What time will it rain?’ ‘Not until 4pm’ This simple stuff is currently WAY outside the abilities of any ‘smart’ assistant.
- ilaksh 3y agoYou can get that today with ChatGPT plugins aside from the voice part. But I assume OpenAssistant can do it now if it's properly configured. Certainly with a weather API and the new ChatGPT API functions thing you can build that in a few days or less. Combine it with Whisper or Google voice input and Eleven Labs very realistic speech output. I think there are quite a few groups with demos that can handle that particular weather thing and basics like it now. Actually Google Assistant probably can handle follow ups to some degree.
- Aeolun 3y agoWould first need to let chatGPT do a separate call to figure out what API to invoke.
- deleted 3y ago[deleted]
- Nihilartikel 3y agoI've had great luck with chatGPT assisted FFMPEG commands. There is very little that FFMPEG can't do as far as video manipulation, but getting a good CLI invocation is a lot of work, documentation surfing, and piecing things together from stackoverflow and Reddit. I don't really feel like committing such things to memory. With ChatGPT, I can ask for it to make a parameterized bash script that takes a path for video input and output, and any other parameters of consequence and make a "converter from x format to Y using Z codec and nvidia hw accelerated encoding at W bit rate" and most of the time, the bash script that it gives me just works and I move it into my tool-bin. It's nice! There are probably a lot of other tedious pieces of automation that it can handle well even in its early state.
- andrei_says_ 3y agoWhat is your process of verifying it?
- scyzoryk_xyz 3y agoI also have had much success with FFMPEG and other bash commands - I just ask it to explain what the command does step by step as I want to learn a bit as well. That being said - it is far from perfect.
- Infinity25 3y agoI think a good way to verify that the commands are actually doing something instead of the LLM just generating non-existent parameters is to provide a dry run mode. The actual correctness of the generated command - granted it's valid - performing as it should however, is a whole different issue.
- ThrowawayTestr 3y agoYou run it. If it gives an error or the output isn't what you want, you tell Chatgpt to try again.
- itairall 3y ago
- Xen9 3y agoI think generative AI will eventually see very wide application on this area and it might be one of the most magical uses for it. Btw, I think Tim Cook should have released Vision with thought controls. Then it'd have been revolutionary....
- al2o3cr 3y agoCan't wait to have every UI make me wonder why I can't GET YE FLASK
- Disha113 3y ago[flagged]