9 ms·
Not a super well thought out article. Example: lots of speculative complaints that ChatGPT will lead to an explosion of low quality and biased editorial materia
by brookst 4y ago
Not a super well thought out article. Example: lots of speculative complaints that ChatGPT will lead to an explosion of low quality and biased editorial material, without a single mention of what that problem looks like today (hint: it was already a huge problem before ChatGPT).
Ditto with the “ChatGPT gave me wrong info for a query” complaint. Well, how does that compare to traditional search? I’m willing to believe a Google search produced better results, but it seems like something one should check for an article like this.
IMO we’re not facing a paradigm change where the web was great before and now ChatGPT has ruined it. We may be facing a tipping point where ChatGPT pushes already-failing models to the breaking point, accelerating creation of new tools that we already needed.
Even if I’m wrong about that, I’m very confident that low quality, biased, and flat out incorrect web content was already a problem before LLMs.
- webjunkie 4y agoAgreed. What is it with everyone wanting to see Chat GPT only in the light of accessing information and then complaining about it?
- brookst 4y agoIt makes me wonder if these people have ever talked to a real person before. Spoiler: real people can be wrong too!
- ceejayoz 4y agoReal people take longer to be wrong. The potential volume one bad actor can generate matters; https://en.wikipedia.org/wiki/Gish_gallop https://en.wikipedia.org/wiki/Gish_gallop is a dangerous enough technique when someone has to actually physically come up with the bullshit. "Gish gallop as a service", essentially.
- mahathu 4y agoYou can trust your friends to not straight up make up facts when they don't know something, like Chat-GPT does, for example.
- starkd 4y agoBecause thats what you do to evaluate it as a service?
- fnfontana 4y agoAnd most people are thinking on ChatGPT like it couldn't evolve. Like it was statically attached to its current state. They are not considering its astonishing potential to evolve. It's just the beginning, just like the internet on the early 90s. Give it 30 more years and we all gonna be AI dependants, like we are on the internet. On the near decades the future generations will not be able to just imagine life before AIs.
- _fat_santa 4y agoIt's already pretty bad with Github/SO threads. Guys will scrape threads on GH/SO and repost them to their sites, usually with a ton of ads but the post ranks higher than the original thread so it will come up first when you google an error.
- Idk__Throwaway 4y ago[dead]
- vernon99 4y agoHow could it rank higher tho? SO has a huge domain ranking. How an arbitrary website can compete with that? I always thought it’s the opposite and platforms like SO and Medium incentivise posting there exactly via their crazy domain ranking.
- kadoban 4y ago> How could it rank higher tho? SO has a huge domain ranking. How an arbitrary website can compete with that? It's unclear, but they do. My guess would be that they're willing to do shadier SEO than SO will, and any that get caught just stand up more domains.
- adventured 4y agoIt's usually temporary, until Google tags the copycat site as a spammy content farm and destroys its ability to rank. I haven't seen a site sustain high ranking / lots of traffic through copying Stackoverflow in maybe a decade at this point (since Panda etc.).
- omnicognate 4y agoIt doesn't matter, though. It's a hydra. Different sites over time but the result is that google results on programming topics are reliably, and increasingly, shit. I gave up on it and pay for Kagi.
- 4y ago
- neonnoodle 4y agoQuantity has a quality all its own.
- SinePost 4y agoGood point. I was already concerned about people's reliance on Google's zero-click answers as the deepest level of inquiry before ChatGPT hit the scene. ChatGPT feels like a multiplier of this convenience factor, being also slightly more specific and generally more consistent.
- dheera 4y agoThere's also just that Google's search ranking doesn't work anymore. I searched "lowest temperatures in boston every year" and got some shit-looking MySpace-like website with a table of temperatures, hell knows where it got its data, instead of a link to the correct page on NOAA or something more authoritative.
- beezlewax 4y agoFull of Google ads probably
- zaroth 4y agoThis is a fun example; First hit in DDG for that query is a trash site but at least the data is there… https://www.currentresults.com/Yearly-Weather/USA/MA/Boston/extreme-annual-boston-low-temperature.php https://www.currentresults.com/Yearly-Weather/USA/MA/Boston/... Versus trying to pull the data from NOAA; https://www.ncdc.noaa.gov/cdo-web/search https://www.ncdc.noaa.gov/cdo-web/search The way that the first site works the keywords into the intro text repeatedly to juice their rank is almost impressive. Can the search engines really not see that the page is garbage?
- soiler 4y agoI mean, what exactly makes the first page garbage? I'm not disagreeing, but "is this site garbage" is not a question that a search engine can ask.
- mh- 4y agoI agree. The real "problem" in this specific case is that the authoritative source (NOAA) seemingly doesn't make the data available in a manner that's discoverable by crawlers. The currentresults.com page seems.. fine? It has a proper source cited at the bottom of the data. I wish it didn't have display ads, but that's the nature of the web nowadays. That's not a problem solvable by a traditional search engine.
- rchaud 4y ago> Well, how does that compare to traditional search? Poorly. Traditional search is a dumb pipe, it gives you multiple links to review and evaluate on the basis of a well-understood PageRank algorithm. It's gotten a lot worse, but humans adapted to its limitations, and know what not to click on (affiliate marketing sites that rank #1 for instance). GPT3 is a dead end, it provides a single response and you can either accept what it tells you or not. It is not going to disclose what links it scraped to provide the information, and it's not going to change its mind about how it put that info together. This is because of the old Arthur C. Clarke axiom "Any sufficiently advanced technology is indistinguishable from magic”." AI peddlers will use every UX dark pattern possible to make it look like what you are seeing really is magic.
- somsak2 4y agoit doesn't have to be this way. check out perplexity ai. it's like gpt in that it's conversational but like google in that it provides references
- blacksmith_tb 4y agoFor sure, though it's easy to imagine a search results page that mixes current organic search results, search ads, and also some kind of AI 'answers' or 'sugestions'. Then we just have to vet those as possibly-dubious-but-maybe-helpful along with the rest.
- ghusto 4y ago> Even if I’m wrong about that, I’m very confident that low quality, biased, and flat out incorrect web content was already a problem before LLMs. Definitely, and I believe the post admits as much. The point he's making is that it's going to get exponentially worse, until the web is useless (the "tipping point" you mention). What are the "new tools that we already needed" though? I think I'm too pessimistic in my outlook on these things, and would be interested to hear your optimistic future scenarios. Right now, my view is that as that as long as something is profitable, it'll continue. A glimmer of hope is that once the web is completely useless, people will stop using it, and we can rebuild.
- fnordpiglet 4y agoThe difference is we can improve the AI to be more accurate, and I suspect before long it’ll generate better content than a human would that’s verifiable with citations. There may come a time where writing is done by a machine much as a calculator does our math. But knowledge maybe shouldn’t be canonically encoded in ascii blobs randomly strewn over the web - maybe instead of accumulated knowledge needs to be structured in a semantic web sort of model. We can use the machine to describe to use the implications of the knowledge and it’s context in human language. But I get a feeling in 20 years it’ll be anachronistic to write long form.
- alfalfasprout 4y agoThe model needs known "good" feedback to improve. The problem is that the quality of its training data declines with the more output produced. It's rather inevitable that we'll be drowning in AI generated garbage before long. A lot of people are confusing LLMs with true intelligence.
- fnordpiglet 4y agoThat’s why I think knowledge needs to be better structured than blobs of text scattered everywhere. An AI can be more than an LLM, Wolfram posted recently about that. You can use the LLM to convert a question into a semantic query and a semantic validator and check and amend and provide a semantic knowledge graph explaining an answer and the LLM can convert it back to meat language. I think people confuse LLM with true intelligence, but the cynics also confuse LLM with a complete and fixed point solution. Your point also seems to assume no curation can happen on what is ingested. Simply because that might be what’s happening now you could also simply train the LLM on known good sources and be as permissive or restrictive as is necessary. Depending on how good the classifiers are for detecting LLM output (openai released on recently) or other generated / automatically derived content you can start to be more permissive. My point is people seem to be blinded by what is vs what may be. This is not the end of the development cycle of the tech, it’s the pre-alpha release by the first meaningful market entrant. I’d be slower to judge what the future looks like rather than assuming everything stays fixed in time as it is.
- munificent 4y ago> without a single mention of what that problem looks like today (hint: it was already a huge problem before ChatGPT). I see this counter-argument all the time and it makes no sense to me. Yes, the web is already filled with SEO trash. How is that an argument that ChatGPT won't be bad? It's a force multiplier for garbage. The pre-existence of garbage does not at all invalidate the observation that producing more garbage more efficiently is even worse.
- jerryzh 4y agobecause most garbage now are all ready produced by script. chatgpt will actually improve them
- argentier 4y agoBetter garbage? More convincing bullshit? Are we winning?
- brookst 4y agoI also see this argument all the time: “New thing X is going to destroy the world!” “Actually it’s an extension of decades-long trends and may accelerate issues we already face” “Well it’s still bad, so any negative statement should be treated as true, even if it’s false!” The article didn’t say ChatGPT was making low quality content worse. It said, in as many words, that ChatGPT will create this problem.
- soerxpso 4y agoSearch engines are already unusable for certain things that they used to be usable for. There's not really a such thing as "even more unusable." If I offer you an oven that doesn't get hot, that's not any better than an oven that makes things colder; you would not want either.
- dTal 4y agoI think we call that a "fridge", and they're quite popular actually...
- 2OEH8eoCRo0 4y agoCost Back in the day you'd have to pay to print your bullshit. Imagine if printing bullshit were free and instant?
- JSavageOne 4y agoI agree that the article doesn't really bring up anything new or interesting. One important implication of a ChatGPT centered web is the removal of reward/credit to content creators. Now when you Google for something you'll probably arrive at some StackOverflow, blog, or Reddit post where there's at least an author's name attached to an answer. But ChatGPT just crawls that content without citing sources, reducing any reward for contributing. Maybe this doesn't have serious implications - after all most people contribute under pseudonyms, but its worth bringing up.
- deleted 4y ago[deleted]
- opportune 4y agoOne major difference is that generated content up until recently was pretty obvious. Tons of stuff like finance articles are autogenerated using templates, and SEO spam is obviously not intended for you as a human. The rest is generally churned out en masse at the cheapest price, so in practice it contains no content and is very poorly written. ChatGPT can produce decent quality content faster and cheaper than most humans. Despite not being fully accurate, and falling apart in certain domains like math, it has an amazing breadth of topics and things it can do at an acceptable level. Right now, enough prompt engineering work is required that it still takes handholding to get ChatGPT to churn out content. But given where we are now it seems well within reach for the next gen of models to be able to go from “Write me an article about X that covers Y and Z” to “Write me 100 articles about varying topics in X” to “Take in the information from this corpus and distill it into 50 articles based on the most interesting parts.” The main thing that should stay safe is detailed technical content like programming guides where you need to actually be able to reason about the material to produce good content, and can’t just paraphrase the ten thousand related sample materials in your training set. ChatGPT is decent about giving mostly-working code snippets (especially if it can use a library, although it may just make one up) but getting it to reason through things will probably require an entirely different approach to how it works. Still, because it’s already capable of producing technical content that passes a basic first glance, it could precipitate a trust crisis. I worry more about what happens when people try to get ChatGPT to generate recipes, or give medical advice, or operate in the support group/personal advice/etc. space.
- MattyRad 4y agoAgreed, particularly given the grammar mistakes. Although, ironically, the grammar mistakes increase confidence that this is an article written by a human.