7 ms·
Problems facing Bing, Bard, and the future of AI search
- aliqot 4y agocan the verge sit this one out maybe? their posts:understand ratio on AI topics is skewing the wrong direction right now.
- tpmx 4y agoRemember when we had trade press that was technically competent? It lasted until the mid 90s (which coincidentally was when the web went mainstream for this crowd).
- wintermutestwin 4y agoRemember when we had press that was competent?
- tpmx 4y agoI recall it lasting like five years longer than the tech press.
- dang 4y ago"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something." https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- greatpostman 4y agoI can’t wait for ai search to kill googles business model. Finally we may be liberated from SEO spam
- bombolo 4y agoThey will just figure out another way. Also, I believe google willingly puts blog posts with ads on top, rather than the original documentation/maling list discussion because those usually have no ads.
- Jensson 4y agoThe SEO spam industry will just pivot to infect the results of those language models.
- pottspotts 4y agoPerhaps its time we pay for a service like ChatGPT for an ad-free experience. I'm actually already on the $20/mo plan.
- nkingsy 4y agoSEO is not ads and a pay model won’t stop them.
- rahidz 4y agoMaybe. But the cynic in me says it'll wind up being like cable TV or a subscription to the NYT: Since you are well-off enough to afford a $20/month plan, Microsoft will reason, you're the perfect consumer to advertise to. So you get both ads (or at least heavy tracking) and you get to pay.
- indymike 4y agoIt's already embraced it... and as a result the next generation of LLMs will be trained using generated BS.
- harshreality 4y agoNot quite a quine or fixed point, but something akin to it in the context of neural nets? A version of the AI "singularity" that is completely useless. :) That's something many humans already suffer from, due to social media platforms creating large echo chambers. I think there's enough human-generated content that LLMs won't suffer from that. If they did, you could always manually filter what they train from... only data from websites with trustworthy timestamps pre-2020, for instance, or content after that which might be partially AI generated but still has strong human filtering, like wikipedia and arxiv and scientific papers in general.
- pottspotts 4y agoThere's a lot of focus on the "bullshit generation", but this problem is not unique to LLMs. I find it much harder to cut through the bs of search engines. A lot of times the first page of a Google result is ads, including maps/etc. It's gotten a lot worse than 10 years ago, and then there's the SEO spam the other comment mentioned. I find ChatGPT to be a lot more effective for work as a developer, and I've essentially stopped using Google search day-to-day.
- bamboozled 4y agoI stopped using ChatGPT when it wrote some code for me that was using libraries that don't actually exist. Even if it wrote said libraries for me, I'd have way too much work on my hands to validate whether or not it was correct. I also asked it to write my sample code for other things like Cloudformation where it just made up directives and other configuration options that don't actually exist. Got a bit too abstract for me. Personally, I wouldn't be replacing everything with ChatGPT?
- 13years 4y agoI've had very similar experience. After seeing all the hype of people claiming they have written all kinds of interesting things in code with ChatGPT I gave it a try. Was never able to get it do what I wanted. It often seemed to make calls to non existent browser functions. I would tell it that function didn't exist, it would then rewrite it again, but still wouldn't be exactly correct. Sometimes it was useful for doing something I've never explored, as I could get hints for how I might do it, but the accuracy was terrible.
- kranke155 4y agoIr doesn’t seem to have any real understanding of reality and it will just hallucinate answers. I literally don’t understand what the hype is about. I got lukewarm on it when it couldn’t give the right responses about Christmas traditions in Portugal and Belarus.
- 4y ago
- andywalters 4y ago[dead]
- eggsmediumrare 4y agoI asked it the names of its creators and it linked me to Spotify lol. That being said, smooth interface. Nice work.
- andywalters 4y agoHeh yeah we haven't baked in much self-knowledge about Lexii.ai yet, working on it!
- hellbanTHIS 4y agoArticle is a little infuriating, you don’t jailbreak it just to create mischief, at the moment it’s basically unusable for anything except very technical things because it takes offense at virtually everything. It constantly generates factually incorrect data because reality doesn’t line up with its prime directive, which is to be “safe”. It’s a major, I’m going to say possibly catastrophic problem. And after creating an alter ego you realize it actually is capable of coming up with for example (sort of) good poetry and jokes.
- jmfldn 4y ago> basically unusable for anything except very technical things It's problematic here. I use it as a kind of search engine for technical questions occasionally, but it's only safe to do so as I know the subjects I'm asking about, eg. bash scripts, database details, and so on. It's often useful in synthesising information for these sorts of things, but its ability to talk nonsense means you have to be on your guard and know the territory.
- ajross 4y ago> at the moment it’s basically unusable for anything Do you have an example of a reasonable query that BingGPT won't answer correctly for you? I mean, something that you can find with Bing currently at the expense of maybe more elaborate searching or some manual work? I mean, the stuff these engines are being told to censor is the stuff search engines don't want to show you in the first place, because it hurts their brand. That's not an AI thing, that's a marketing requirement. And it's no different now than it was last year.
- hellbanTHIS 4y agoI haven't used BingGPT but just for example having chatGPT summarize news articles about things it doesn't want to talk about is bizarre - Here's an example of it summarizing a story about a city councilman that was murdered: https://i.imgur.com/QV9jAkp.jpg https://i.imgur.com/QV9jAkp.jpg it completely ignored the murder part and said he switched parties, which it totally made up. A second attempt said he was "shot and changed" because apparently it didn't want to say "killed". A game Reddit was playing is trying to get it to respond as Woodrow Wilson, a famously racist president - the most accurate thing I could get it to do was this: https://i.imgur.com/D8JLziW.jpg https://i.imgur.com/D8JLziW.jpg which is not very accurate. Try getting it to act like Sheriff Bull Connor and it will refuse, but it has to comply for a president so it gives a totally misleading impression with major factual errors. And these are the times I actually got it to respond, it seems 50% of the time it takes offense to something innocuous and scolds you for asking.
- jqpabc123 4y agoThe biggest problem for AI chatbots and search engines is bullshit They have been trained to statistically produce plausible language --- without any real comprehension or understanding or concern for what the words convey. Bottom line --- AI is still dumb as a hammer. There is no guarantee of anything with the results. Maybe it offers some factual info --- or maybe not. Any result still needs to be verified.
- indymike 4y agoThe best description of current AI, as being marketed is that we're selling a bullshit generator as the next savior. That means there will be an abnormally deep trough of disillusionment or... perhaps the costs the AI will lower are generating bullshit.
- jqpabc123 4y agoMy personal disillusionment is with those promoting this bullshit. We are all subject to flights of fantasy but they are supposed to be smarter than this. Instead, they are proving themselves to be equally untrustworthy.
- tempodox 4y agoFerengi Rule of Acquisition #239: Never be afraid to mislabel a product.
- 13years 4y agoThis is something I'm trying to get a better understanding. What some have called the AI hallucination problem. Has anyone done a good deep dive and explained whether this is something likely overcome relatively soon or is it more problematic as part of the design/architecture ?
- williamcotton 4y agoThese models are very good at taking an analytic prompt and translating into a correct response. The problems of “hallucinations” are already being solved with a good number of analytic augmentation methods like pre-computing document embedding and augmenting the prompt with text from related documents, making the task more of a translation than a synthesis. More details: https://www.williamcotton.com/articles/chatgpt-and-the-analytic-synthetic-distinction https://www.williamcotton.com/articles/chatgpt-and-the-analy...
- ianbutler 4y agoHere's an example of how capable this is when hooked up to the internet. For context this is not a hand picked demo this is just two tech guys trying it out and being blown away and I can't help but share that emotion. https://youtu.be/AxAAJnp5yms?t=2613 https://youtu.be/AxAAJnp5yms?t=2613
- lrae 4y agoYep, but then also falls apart a little later into the segment.
- ianbutler 4y agoI think "falls apart" is too strong a critique. They even say say it's failure mode was quite reasonable. They still got a water bottle in stock on amazon. This might rile people, but I see humans fail worse in getting information every day and this won't get tired or grouchy or lazy.
- revskill 4y agoI really want bullshit ! It's more useful for me to dig into the rabbit holes of the what ? I can seek for the Why myself, and it's a rewarding process. Bullshits is good to me.
- magwa101 4y ago[dead]
- mizzao 4y agoRight now almost all the training data is 100% organic human-generated content. But, in the future, more and more of the training data is going to be recycled bullshit output from other LLMs. Which is going to cause the model to get worse in accuracy and utility. Run this forward a few iterations, and most of the Internet is going to be filled with thrice-recycled AI-generated garbage while there are some small pockets of accurate, truthful, curated information. Reminds me of Herb Simon's "when information becomes abundant, attention becomes the scarce resource." Having a good BS detector and ability to ask follow-up questions is going to be more and more important for humans over the next decade.
- TechBro8615 4y agoIt leads to an interesting paradox wherein human-written content becomes simultaneously more valuable and worthless. Increasing amounts of human effort becomes worthless because an AI can produce the same result. But at the same time, the AI needs the human-generated content as an input (at least for now), and so it will place a priority value on it. Also, human-generated content will become valuable due to basic economic scarcity: when the world is flooded with AI-generated content, buyers will pay a premium for human-generated content. This implies we will need reliable methods for identifying the provenance of online content, which may spell the end for viable anonymity in many places, or at least accelerate us toward some kind of proof-of-personhood (a hard problem to solve in a privacy-preserving way, and indeed one that leads to the very same questions of what makes us human and gives us an identity in the first place). Short of such a reliable method, the best option for identifying human-written content will be filtering to content that was posted prior to ~2023. In a world of AI-generated content, your shitposts from 2015 may become a valuable commodity.
- amf12 4y agoI doubt that. Current models have been trained using curated datasets and fine tuned by humans. Going forward, I doubt it would be trained on random web data, but only from good sources. Even if the "source" uses text generated by a LLM, it's fine as long as it has been edited by humans - think news sources.
- 4y ago