5 ms·
> Now with LLMs, I simply prompt the same with a little bit more of context "pros and cons of using mysql vs mongodb when storing photos. Link references". In
by Viliam1234 1y ago
> Now with LLMs, I simply prompt the same with a little bit more of context "pros and cons of using mysql vs mongodb when storing photos. Link references".
In near future, companies will probably be able to pay lots of money to have their products come up better in the comparison. LLMs are smart enough to make the result seem "organic" -- all verifiable information will be true and supported by references, it will only be about proper framing and emphasis, etc.
- pietmichal 1y agoThis was already a problem in a world without LLMs. Reputation is the only human mechanism that mitigates this.
- SpaceNoodled 1y agoIt's seriously exacerbated by smug LLMs.
- sothatsit 1y agoI'd say LLMs have helped a lot with this problem actually, by somehow circumventing a lot of the decades of SEO that has now built up. But, I fear it will be short-lived until people figure out LLM optimisation.
- n4r9 1y agoTechnology is a catalyser. It has a knack of turning things from "already a problem" to "now a catastrophe".
- djray 1y ago"To err is human, but to really foul things up you need a computer." -Paul Ehrlich
- shoomkloom 1y agoNow LLMs will create your bugs for you!
- Toritori12 1y agotbf, Google has pretty the monopoly on search engines, the rest is way behind (even after enshitification). LLMs seems to be a more competitive space.
- jeremyjh 1y agoKagi is already far better than Google. It doesn’t effect me if Google gets all the traffic.
- teaearlgraycold 1y agoThey’re already talking about llm search optimization as the new SEO.
- ukuina 1y agoI believe the term is Generative Engine Optimization (GEO).
- kridsdale3 1y agoShit. That's the name of my org. (Geo-spatial data)
- andruby 1y agoI'm very grateful that we have a lot of players training LLM's, including several that are published as open models and open weights. I fully expect LLM results to start including ads, but because of the competition I hope/believe the incentives are much better than they are for, say Google's search monopoly. It could potentially be more insidious though. We'll probably start sending prompts to multiple models and comparing the results with lower-power local models.
- jeremyjh 1y agoOpen weights don’t solve it; the promotion will happen during post training and the results will be in the weights.
- avgDev 1y agoI start with "I don't have any money, I need an open source library that does this" lol.....even at work.
- sothatsit 1y agoI really hope that they don't include ads in paid tiers. But I'm not sure how much you would actually have to pay to cover the potential lost ad revenue... it might be too much.
- plastic-enjoyer 1y agoWould be funny if LLMs get SEO'd to death and go the same way as search engines
- DrillShopper 1y agoThis would be the Kessler Syndrome of the Internet, and it will be glorious.
- Gormo 1y agoThis already happens unintentionally, e.g. Wikipedia loops, where bad info on Wikipedia gets repeated elsewhere, and then the Wikipedia article gets updated to cite that source. When LLM-generated content is pervasive everywhere, and the training data for LLMs is coming from the prior output of LLMs, we're going to be in for some fun. Validation and curation of information are soon going to be more important than they've ever been. But I don't think there'll be too much intentional manipulation of LLMs, given how decentralized LLMs already are. It's going to be difficult enough getting consistency with valid info -- manipulating the entire ecosystem with deliberately contrived info is going to be very challenging.
- nocman 1y ago> LLMs are smart enough to make the result seem "organic" I would never describe the output I've seen from LLMs as "organic".
- bas_sen 1y agoThis is already the case, SEO content, sponsored comparison sites, influencer marketing, it's all about subtle framing. LLMs just supercharge the problem by making it easier and cheaper to scale. The real issue isn't that LLMs lie, it's that they emphasize certain truths over others, shaping perception without saying anything factually incorrect. That makes them harder to detect than traditional ads or SEO spam. Open-source LLMs and transparency in prompt+context will help a bit, but long-term, we probably need something like reputation scores for LLM output, tied to models, data sources, or even the prompt authors.