4 ms·
I did the same thing for several iterations and all of the responses were equally helpful. We get these same anecdotes about terrible AI answers frequently in
by Aurornis 1y ago
I did the same thing for several iterations and all of the responses were equally helpful.
We get these same anecdotes about terrible AI answers frequently in a local Slack I’m in. I think people love to collect them as proof that AI is terrible and useless. Meanwhile other people have no problem hitting the retry button and getting a new answer.
Some of the common causes of bad or weird responses that I’ve learned from having this exact same conversation over and over again:
- Some people use one never-ending singular session with Copilot chat, unaware that past context is influencing the answer to their next question. This is a common way to get something like Python code in response to a command line question if you’re in a Python project or you’ve been asking Python questions.
- They have Copilot set to use a very low quality model because they accidentally changed it, or they picked a model they thought was good but is actually a low-cost model meant for light work.
- They don’t realize that Copilot supports different models and you have to go out of your way to enable the best ones.
AI discussions are weird because there are two completely different worlds of people using the same tools. Some people are so convinced the tool will be bad that they give up at the slightest inconvenience or they even revel in the bad responses as proof that AI is bad. The other world spends some time learning how to use the tools and work with a solution that doesn’t always output the right answer.
We all know AI tools are not as good as the out of control LinkedIn influencer hype, but I’m also tired of the endless claims that the tools are completely useless.
- JohnMakin 1y agoThe thing responses like this miss I am pretty sure is that this is a nondeterministic machine, and nondeterministic machines that are hidden by a complete blackbox wrapper can produce wildly different results based on context and any number of independent unknown variables. so pasting “i did the same thing and it worked fine” is essentially this argument’s version of “it worked on my local.” Or it essentially boils down to “well sure, but you’re just not doing it right” when the “right” way is undefined and also context specific.
- josephg 1y agoYou’re both right. Some problems should be solved with better user education. And some should be solved with better UX. It’s not always clear which is which. It’s too simple to blame everything on user error, and it’s too simple to blame everything on the software. Cell phones are full of examples. So much of this stuff is obvious now we’ve been using them for awhile, but it wasn’t obvious when they were new. “My call dropped because I went in a tunnel” is user error. “My call cut out randomly and I had to call back” is a bug. And “my call cut out because my phone battery ran out” is somewhere in the middle. For chatbots, lots of people don’t know the rules yet. And we haven’t figured out good conventions. It’s not obvious that you can’t just continue a long conversation forever. Or that you have to (white consciously) pick which model you use if you want the best results. When my sister first tried ChatGPT, she asked it for YouTube video recommendations that would help when teaching a class. But none of the video links worked - they were all legitimate looking hallucinations. We need better UX around this stuff. But also, people do just need to learn how to use chatbots properly. Eventually everyone learns that calls will probably drop when you go into a tunnel. It’s not one or the other. It’s both.
- jiggawatts 1y agoEverything is like this. I saw an IT professional google “My PC crashed” to diagnose a server bluescreen stop error.
- sunaookami 1y agoSome people are so convinced the tool will be bad that they give up at the slightest inconvenience or they even revel in the bad responses as proof that AI is bad AI derangement syndrome
- muppetman 1y agoThe "pick your model" thing is so stupid. "How dumb do you want your AI to be?" "Why do I have to select?" "Because smart costs money" "So... I can have dumb AI but it's cheaper?" "Yes" "How would the average person know which to pick?" "Oh you can't know." I hope they can invent an AI that knows which AI model my question should target cheaply.
- reilly3000 1y agoI think you make a good point. Cursor is doing a basic “auto” model selection feature and it could probably get smarter, but to gauge the complexity of the response you might need to run it first. You could brute force it with telemetry and caching if you can trust the way you measure success.
- HappMacDonald 1y agoYou bring up the important point that for a company who earns money off of tokens wasted, a confusing selection of models can translate into extra spend to experiment with tweaking them. Some users may not appreciate that, but many more might be drawn to the "adjust the color balance on the TV" vibes.
- addandsubtract 1y ago> I hope they can invent an AI that knows which AI model my question should target cheaply. Isn't that the idea of OpenRouter?
- oersted 1y agoNot exactly, but yeah. OpenRouter is a unified API, directory and billing system for LLM providers. I think you are getting confused by the term "Model Routing", which to be fair OpenRouter does support, but it's a secondary feature and it's not their business focus. Actually OpenRouter is more focused on helping you choose the best provider for a specific open model based on their history of price, speed, reliability, privacy... The model routing is simply provided by NotDiamond.ai, there are a number of other startups in this space. https://openrouter.ai/docs/features/model-routing https://openrouter.ai/docs/features/model-routing
- rienbdj 1y agoReminds me of I’m Feeling Lucky -> bad result -> Google search is useless
- krige 1y agoYeah except Feeling Lucky is the only button you can press and people blame you if they got lucky
- darkwater 1y ago1. I would say that nobody did that, so you are making up a straw man 2. The Copilot or ChatGPT or Claude "Ask" buttons should then be renamed to "I'm feeling lucky". And that would be the only button available.
- msgodel 1y agoThis is part of why I really like local models. I always use the same random seed with mine so unless I'm using aider the responses are 100% deterministic. I can actually hit c-r in my shell to reproduce them without having to do anything special.
- lukan 1y ago"I’m also tired of the endless claims that the tools are completely useless." Who claimed that here? I read a claim that Copilot is dumber than claude and ChatGPT and I tend to confirm this. "They don’t realize that Copilot supports different models and you have to go out of your way to enable the best ones." So possible that none of us who thinks that, went out of our way to find outy when there were working alternatives, but it would be still on Microsoft making it hard to make good use of their tool.
- hbn 1y agoYeah I'm not sure why they'd think my point was that LLMs are useless. Clearly I'm integrating them into my work, I just think Copilot is the dumbest. It's given me the most nonsensical answers like the example I provided, and it's the one I use the least. Which is even crazier when you consider we're on a paid version of Copilot and I just use free ChatGPT and Claude.
- hluska 1y agoYour entire comment sure read a lot like you were calling the tools useless. You even used the worst possible prompt to make your point. That’s likely why people are reacting badly.
- hbn 1y agoI said the Copilot is the worst competitor in the space. Where did I say anything in general about LLMs being useless?
- ryanar 1y agoThe memory feature also can be a problem, it injects stuff into the prompt context that you didnt explicitly write with the intent it will help because it knows you are a python programmer so lets respond with a python script instead of our usual ffmpeg cli command.
- otabdeveloper4 1y ago"Spin the chatroulette again and see if you vibe something better" is not a foundation for a business. Well, unless your business is selling vibes.