7 ms·
It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- an
by cl42 4y ago
It's amazing how many researchers underestimate the importance of UX and design.
Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing!
A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a collective experience.
- Turing_Machine 4y agoIndeed. This reminds me of the people who were unimpressed by the iPod because there were other MP3 players already on the market. Sometimes "making the first X that doesn't suck" is a lot more important than "making the first X".
- ryanSrich 4y ago> It's amazing how many researchers underestimate the importance of UX and design. Yes. Also the fact that ChatGPT's UX and design leaves much to be desired. They could add/improve the product in so many obvious ways. I wonder if they either 1.) don't care, or 2.) have plans to, but are holding off until they take on a subscription fee.
- Turing_Machine 4y agoIsn't there an API?
- cl42 4y agoWhat would you change to the UX and design to make it even better?
- baxtr 4y agoThe slow spell out is really annoying. If they want to rate limit fine. But give me the answer faster and then lock queries for a few seconds instead.
- cloudking 4y agoThe spell out is a limitation of the way the model works, it predicts the text word by word.
- baxtr 4y agoYes I get that. But just speed the god damn thing up.
- visarga 4y agoThe god damn thing has to do 175B multiply and add operations for each one of your words.
- baxtr 4y agoWho cares? OP was asking about UX improvements. Maybe I missed the part, but IMHO no one was asking only for UX improvements that come cheap.
- visarga 4y agoThey said "just speed the god damn thing up" - this is related to model inference speed. If your answer is one page long (about 2000 tokens), be prepared to wait for a whole minute.
- ryanSrich 4y agoI’d much prefer the type be hidden until it’s ready entirely.
- slaymaker1907 4y agoIt seems to log me out every day unlike pretty much every other web service besides banks.
- cma 4y agoEntering and editing text on a small touchscreen with it is a pretty bad experience. The keyboard covers the text, linebreaks can't be entered without pasting, viewing the output requires closing the keyboard. None of these are problems to the same degree in say Discord's mobile/tablet UI.
- visarga 4y agoIt has some issues when you edit a prompt that has very long text, it will snap to the end when you type losing focus.
- liuliu 4y agoAdd "calculator" in a form of Python interpreter to give alternative result. Providing interactive graphical interface for some of the charts they shown. Connecting outside sites for booking, pictures, user comments. To some degree, WolframAlpha putting more efforts into the UX than ChatGPT.
- cl42 4y agoI was going to ask you re: WolframAlpha. I think your suggestions are great ideas. Citing sources, providing links, and even possibly visuals. That's also how I think ChatGPT could really attack the search space.
- PartiallyTyped 4y agoIt's quite fascinating how information retrieval and search engines have evolved.. From trying to teach people how to google via "I am feeling lucky", to using language models for ranking, to building LLMs to better adapt to user queries and move beyond keywords, to having arguably useful chatbots that can synthesize responses. I am curious to see what the future holds. Maybe an AI that can anticipate our queries?
- visarga 4y agoI also saw the "LLM as database" metaphor. Up until 2020 we had databases in the backend, UI in front, now we can have LLMs in the backend.
- PartiallyTyped 4y agoFor the uninitiated https://news.ycombinator.com/item?id=34503418 https://news.ycombinator.com/item?id=34503418 Maybe, eventually, LLMs can be used to synthesize and cache certain APIs ... who knows :D
- smoldesu 4y agoClarke's third law: "Any sufficiently advanced technology is indistinguishable from magic." Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess. I mostly agree with the headline here. ChatGPT is hardly any more innovative than a Markov chain.
- canjobear 4y agoResponses like this are highly predictable in response to prompts about ChatGPT.
- abm53 4y ago> thought and heuristic patterns I’m not sure these are well-defined enough terms to make this claim.
- smoldesu 4y agoHeuristics is the ability to recognize multiple options and reason which one is correct. ChatGPT (and all GPT models for that matter) have a single context that doesn't get compared to other possible generations. You can back-propegate and see which tokens influenced the output most, but there is no evidence that AI can conceive multiple hypothetical responses and select the most-preferred one. At least not ChatGPT.
- visarga 4y agoHave you heard of "beam search"? The model keeps a number of optional lines of text without being greedy and picking only the most probable token every time. You can also sample with T>0 multiple times to get an ensemble of answers that can be used as input for another AI operation. You just need to do multiple interactions with the model.
- visarga 4y ago> and only gives you the most-likely response to your prompt That "only" carries a lot of weight on its back.
- idopmstuff 4y agoI don't think he's underestimating the UX/design piece, I think it's just outside of the scope of what he's talking about. It seems pretty clear to me that his statement is talking about the underlying AI technology (which makes sense given his background). And in any case, I wouldn't call anything about the UX or design here innovative - it's obviously a huge improvement in terms of usability, but a chat UI is a pretty well-established thing.
- Waterluvian 4y agoThen what left is there to explain why this is so much different from the well-established stuff?
- hnfong 4y ago"The implementation is left as an exercise to the reader."
- Waterluvian 4y agoIt’s easy. Just draw the rest of the owl!
- cl42 4y agoI think the idea of a "prompt" is actually pretty cool. I never saw that framing prior to GPT-3 and I think it reframes the entire idea behind what a model does and how you interact with it.
- visarga 4y agoNobody talks about the dataset. Yes, the model was not innovative. But why hasn't anyone equaled OpenAI yet? Maybe they innovated on data engineering.
- sandworm101 4y ago>> using prompts for the first time -- and getting results that make sense -- is so incredible. Years ago it was possible to insert prompts into Google and get results that made sense, results that were meaningfully tied to the information you requested. The young people today who missed that time think it magic.
- cl42 4y agoI think this is fundamentally different because you can play with it, and people want to play with it. Google isn't a playground -- it's much more utilitarian. You go there when you need to find a doctor in Seattle, or to research politics in Poland, or something. You get results which are great, but you don't need to stick around. GPT-3 and ChatGPT allow you to spend time playing with the system and having fun with it[1]. I think this is what makes it so viral and interesting to people. [1] https://10millionsteps.com/ux-ai-gpt-3-click https://10millionsteps.com/ux-ai-gpt-3-click
- lostmsu 4y agoYes, but the kind of responses were different.
- visarga 4y agoThat wonder might not be lost forever. Can't we have access to an old index and cached web pages?
- scifibestfi 4y agoAnd/or underestimate the importance of shipping.
- cl42 4y ago100%. I think Hugging Face is awesome here as well. The # of times I've tried to clone a GitHub repo and run a model on my own only to get 50 errors I can't debug.... :)
- MisterPea 4y agoThis is the bigger thing over UX/design. Someone on twitter likened this to when Xerox invented the mouse, but Apple/Microsoft shipped it with their PCs
- deleted 4y ago[deleted]
- zwieback 4y agoAgreed. He did say that it was "well put together and nicely done", though.
- random3 4y agoResearchers point of view is based on their area of research and that's fair and expected. Yann LeCun compares ChatGPT in the context of the related research. Imagine a ChatGPT equivalent that memorizes many questions and does a brute force strategy for an answer. It may "look" magic, but there's nothing magic about it. We all accepted that this is the case with Blue Gene - https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer) https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer) What's different here? Productization and usability are difference concerns here and Yann LeCun is not a usability researcher. Granted, that doesn't mean usability/accessibility doesn't impact research outcomes.
- cl42 4y agoOK, I'll defend the research, too. OpenAI's really interesting approach to GPT was to scale the size of the underlying neural network. They noticed that the performance of an LLM kept improving as the size of the network grew so they said, "Screw it, how about if we make it have 100+ billion parameters?" Turns out they were right. From a research perspective, I'd say this was a big risk and it turned out they were right -- bigger network = better performance. Sure, it's not as beautiful as inventing a fundamentally new algorithm or approach to deep learning but it worked. Credit where it's due -- scaling training infrastructure + building a model that big was hard... It's like saying SLS or Falcon Heavy are "just" bigger rockets. Sure, but that's still super hard, risky, and fundamentally new.
- belval 4y ago> OpenAI's really interesting approach to GPT That's the issue though, Yann LeCun is specifically referring to ChatGPT as the standalone model, not the GPT family since a lot of models at Meta, Google, DeepMind are based on a similar approach. His point is that ChatGPT is a cosmetic additional training with prompt with a nice interface, but not a fundamentally different model than stuff we've have had for +2-3 years at this point.
- cl42 4y agoChatGPT is build on GPT-3. GPT-3 was a big NLP development. The paper has 7000+ citations: https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165 It was a big deal in the NLP space. It wasn't a 'cosmetic' improvement over existing NLP approaches.
- version_five 4y agochatGPT is innovative in the way the iPhone was innovative. That, of course can be market winning, but it's dangerous, especially for businesses and investors, to get caught up in hype that there is some new "AI" out there that can do things we previously couldn't
- Gigachad 4y agoCan you point to any product where I could do what chatgpt does before chatgpt? Feels like we just leapfrogged from dumb markov chains to something incredible that provides real value.