9 ms·
The key way I try to distinguish "Snake Oil" is: Is anyone actually using this routinely, and are the problems it solves self-evident to new non-zealot users af
by Someone1234 3y ago
The key way I try to distinguish "Snake Oil" is: Is anyone actually using this routinely, and are the problems it solves self-evident to new non-zealot users after a demo?
Take blockchain for example; people spent years and millions of dollars looking for additional usages for the technology beside coins/coin-contracts; and aside from the forementioned usages it didn't really gain routine adoption. That was why the non-coin-blockchain always struct me as a "hype train" or "snake oil" because it was a solution in search of a problem. NFTs are even worse since they haven't found any purpose to exist yet (money laundering?).
Contrast that with the "GPT" offerings (ChatGPT/Bing/Copilot/Bard/etc). Multiple of my colleagues are actively using them routinely every workday and when you demo it to another person, they understand it, and they too start utilizing it in their workflow. Heck, my mom discovered it herself on Bing's homepage and was telling me I should check it out.
That's the opposite of "snake oil" or a hype train, it is arguably a competitive threat to search engines.
PS - Small disclaimer: "AI" is a nebulous term. I'm talking specifically about LLMs. Other types of "AI" have already been here for a long time making our lives better (e.g. computer vision).
- lIIllIIllIIllII 3y agoI'm routinely using LLMs in place of search engines. Would you rather type in a cocktail and instantly get a recipe? or do you want to open google, scroll past 50 ads, click through a bunch of blogspam that gives you the history of cocktails, the prohibition, the chemical formula for ethanol and their life story, followed by a recipe that was itself generated by a substandard AI model anyway edit: I'm prepared for the enshittification of GenAI, but given competitive edge, many people will pay top $ for faster/higher parameter inference, I'm hoping ad support is minimal on the super deluxe god tier AI subscription which I'll have to pile all of my spare cash into.
- danmur 3y agoIf you pay for search you get some of those benefits already
- chargingmarmot 3y agoSincere question: what paid search do you have in mind? How conceptually could a paid search engine solve the problem of SEO and spam? (Curation seems economically infeasible?) Is what you're actually proposing ad-free search results? (I'd be willing to pay Google approximately $0.01 per search for this. I suspect this is probably more than they get from anything but the most expensive ads (pharma ads that confused old people will click on).) What I would really love is a browsing-assistance agent based on something like an LLM that can summarize and de-cruft search results for me and show me content extracted from web pages in a standard format without any Javascript. (I don't need an LLM to be the arbiter of truth, I just want it to be good at summarizing documents.) (Because Google is so wedded to the ad ecosystem I'm not sure I trust them to be the steward of technology that is basically about removing ads from my life.)
- lhl 3y agoKagi https://kagi.com/ https://kagi.com/ is the paid search I've tried. It's was decent, but not a noticeable enough improvement to win me over as a customer. OTOH, I am a paying ChatGPT Plus user and there are some days where I feel like I get my monthly subscription price's worth in a single day. In terms of summarization, this study Anyscale just published is interesting - llama2-70b gets within a hairsbreadth of gpt-4/human scores for summarization, so it's conceivable that sometime soon, you might be able to run a local LLM on your browser and get decent results (4-bit quants of llama2-70b currently take about 40GB of memory, you need at least 2 x 24GB or 1 x 48GB GPU to run them at reasonable speeds atm): https://www.anyscale.com/blog/llama-2-is-about-as-factually-accurate-as-gpt-4-for-summaries-and-is-30x-cheaper https://www.anyscale.com/blog/llama-2-is-about-as-factually-...
- girvo 3y agoWho do I pay for better search? Honest question, I'd love a recommendation.
- lelandbatey 3y agohttps://kagi.com/ https://kagi.com/ is the one I see recommended. The results went to focus hard on "no blogspam" which is nice, and supposedly you can completely ban whole sites from your results forever (e.g. goodbye GeeksForGeeks and your shit SEO hacking)
- __loam 3y agoI have two concerns when people tell me they're using this stuff like a search engine: 1. How expensive are these to operate when compared to search engines? If search engines are about as good at information retrieval, but are much cheaper, what does that mean for the future of these services? 2. How good are these systems actually when compared to search engines? I get that for things like code, you can immediately verify results through testing, but GPT was trained on what looks good to humans thanks to HFRL, not necessarily for correctness. I really wonder what's going to happen with this comparison in the near future. I think there's two possibilities: 1. Running inference on models and keeping the models relevant by introducing new data remains extremely expensive and companies like OpenAI operate at massive losses. Eventually this leads to their products getting worse. 2. Models get cheaper to run and efficient enough to run on mobile hardware without losing much fidelity. OpenAI still might be in trouble in this scenario if "open source" models like Llama2 get popular.
- riku_iki 3y ago> or do you want to open google, scroll past 50 ads, click through a bunch of blogspam that gives you the history of cocktails, the prohibition, the chemical formula for ethanol and their life story I think in this aspect the difference between GPT vs Google not in level of tech, but because GPT took text from copyright owners and distributes it without their consent and without showing their ads, which is being challenged legally in my understanding.
- struant 3y agoDoesn't matter. If governments blunder this and try to enforce copyrights in AI, then we are all going to be using Chinese AI in 5 years instead of Google because they don't give a damn about copyright.
- riku_iki 3y agoCCP already created its own regulation rules for AI.
- mthoms 3y agoAnd what does it say about copyright? Genuinely curious.
- riku_iki 3y agointernet articles say something about copyright protection, but more important part is that AI has two promote core values of socialism and avoid statement criticizing Chinese government.
- daveguy 3y agoInteresting that the CCP rules for AI are the same as the rules for any meatI under their control. At least they are consistent.
- aperrien 3y agoOr you can run your own open source AI, on your own hardware.
- yeahwhatever10 3y agoI prefer search engines because I can look through multiple sources. LLMs just give an answer without context or what alternatives might be. They make it difficult to judge to validity of the response.
- bsilvereagle 3y agoperplexity.ai usually gives 4-6 sources that you can validate the response with. As far as I can tell, it performs a search and then feeds the full text of the search results to an LLM and present a summary with citations.
- theonlybutlet 3y agoNot all questions need a variety of answers. If its good enough for your needs go for it. Saves some time searching.
- Turskarama 3y agoIt depends on how important it is that I get a precisely correct answer. For a cocktail it's not a big deal if I get one that's slightly different, in other cases an incorrect answer might be catastrophic.
- md_ 3y agoAmusingly, Kevin Roose and Casey Newton made a ChatGPT-authored cocktail recipe on "Hard Fork" a while back: https://www.nytimes.com/2023/06/30/podcasts/hard-fork-ai-poison.html https://www.nytimes.com/2023/06/30/podcasts/hard-fork-ai-poi.... I think the review was basically, "I’ve had worse cocktails. I’ll be honest." So...meh?
- theonlybutlet 3y agoUsing bing chat, you always just check the source of its answer if it's crucial. Saves time searching.
- TuringNYC 3y agoAnother test is whether kids use it w/o being forced to. My kids are obsessed with both MidJourney and ChatGPT. They have found use cases w/o any profit motive and w/o any outside pressure. No amount of Blockchain "Webinars" would have convinced my kids to use the blockchain.
- viscanti 3y agoIf blockchain did fulfill the claims of it revolutionizing the world of finance, it's still unlikely your kids would have become obsessed and regular users of it. If room temperature and pressure superconducting or nuclear fusion became viable, your kids might also be unlikely to play around with them on their own. Kids apparently love Roblox and most adults think the metaverse is dead. What kids like seems pretty orthogonal to what is legit or snake oil.
- TuringNYC 3y agoPoint taken, but how about these: - My mom cant figure out Blockchain either - My sister (doctor) and brother (3 degrees) cant figure out Blockchain either, because they are too afraid of scanning the wrong QR code and having their balance drained My mom, sister, and brother all use ChatGPT. My brother uses it actively for work.
- pdntspa 3y agoYou can dig deeper.... what exactly are the real-world applications of an immutable transaction ledger? I can't think of very many. Let alone a bunch of kids.
- somenameforme 3y agoDecentralized is critical to the recipe as well. 'Immutable' centralized ledgers are largely a non-starter because the scenarios you want to use block chain for are zero-trust type scenarios. With centralization, the promise of immutability holds exactly as long as it's convenient for the centralizing power. In any case, defining public use or accessibility as the metric of relevance of something is quite illogical. You end up with countless absurdities like relativity being worthless and CocaCola being the most relevant invention ever.
- backendanon 3y ago> Heck, my mom discovered it herself on Bing's homepage and was telling me I should check it out. Sounds like grade A Microsoft marketing speak. But wait, there's more!
- noman-land 3y agoNFTs as domain names is novel, interesting, and non-financial. https://ens.donains https://ens.donains
- chargingmarmot 3y agoMy belief is that blockchain-based solutions are typically inferior to centralized ones except when the goal is to evade regulation. (Crypto is good for dealing in contraband, dodging currency controls, and collecting ransomware; but it's always less efficient than centralized solutions with a trusted authority. And the only time you can't find a trusted authority is when you're trying to dodge regulation.) In this instance, I don't see how this offers any advantage over the usual registrar-based DNS: at the end of the day I'm just using the ENS rootnode keyholders as my registrar, and I don't see how the blockchain is solving any problem that couldn't be more efficiently solved with a traditional database.
- noman-land 3y ago"Evading regulations" is a phrase that holds a different weight when you don't live in a free society. "Evading regulations" could be using a gay dating app in Iran. Or organizing to fight against a repressive government in Russia. Even in so-called civilized Western nations, there are increasing tendencies toward autocratic rhetoric and encroachments into personal liberties. See: abortion access in the United States. Not too long ago the US government put pressure on all financial institutions to stop processing payments for Wikileaks without them ever having been convicted of committing any crimes. That's just a single example plucked out of the sky, regardless of your feelings about that organization. The great advantage that we get from a decentralized, opt-in trust infrastructure is that we have an avenue around these unjust and extralegal encroachments. Having said all that, even if you don't care about politics, there are countless examples of centralized entities changing ownership, or changing strategies, and their users pay the price. See: Twitter taking people's usernames. You might be fine with dealing with living at the whims of billionaires but I want my digital life to be more durable than that.
- 3y ago
- gen220 3y agoAre people durably achieving a competitive advantage through the GPT? I think we've seen some people striving for a competitive advantage, and willing to see one exist, but I don't know if we've seen any "AI company" turn a meaningful and durable profit yet (open to being wrong on this). To me (so far), it seems like GPT use cases that apply it as a table stakes feature of some greater application (rather than an ecosystem or a platform), are the ones that are actually showing promise in terms of expected utility + value capture. If GPT4+ level engines become as cheap to execute as a SQLite query, I think that's where things get interesting (you can start executing this stuff at the edge). But I still can't see new companies (a la OpenAI, MidJourney, etc.) making a lot of money in this scenario, it seems to overwhelmingly favor companies that already have distribution.
- antoniuschan99 3y agoFor programming it’s like an additional feature on top of Google. You can dump entire error logs, get correct syntax (i give it a 4/10 for accuracy though), and even dump your entire page of code if there’s a bug in it. Yea the sql queries, string or array manipulation are better and fast than google 8/10 times because of the errors it generates.
- lumost 3y agoWe're likely way too early to call this one. Based on current hardware trends, GPT-4 will run on your phone within 6-10 years. Right now, folks are feeling out the edges of what makes sense and what doesn't make sense at extreme R&D and opex expense. In 10 years, we'd expect the winners of today to still be winners and have great margins due to declining compute costs. Granted, if you are spending 10x the future value of the product your are offering ... then even a 10x decline in compute costs won't get you where you need to be.
- riku_iki 3y ago> Based on current hardware trends, GPT-4 will run on your phone within 6-10 years they quantized model from 16 bits to 4 bits which was low hanging fruit, and looks like they can't quantize it anymore to 2 bits..
- skepticATX 3y agoThe authors specifically state that they do not think that GenAI is snake oil. You can’t legitimately argue that it is. On the other hand, I’m not sure that you can legitimately argue that it is not over-hyped. The only way that it isn’t is if we achieve “singularity” imminently - because that it is what a sizable number of people, including possibly some people at OpenAI, are actually expecting.
- blackkettle 3y agoI think we’re nearing the point of the initial dotcom bust. A whole of internet startups went completely belly up when the early 2000s initial bubble burst. That was no reflection of the actual potential it just indicated that people at all points of the value chain had not yet grasped how or what the internet was or how it would mesh with humanity. That’s where we are now. It’ll burst but not because it’s overhyped; because we don’t collectively understand the implications.
- throwawaylinux 3y agoWell that's a bad criteria. A lot of people get hooked on "snake oil", and will even try to seek it out. Astrology, alternative medicines, crystals, vibes, etc., cults and other such religious beliefs, various social, economic, political and other beliefs that aren't supported by evidence. Lots of them aren't "zealots", they're pushed by fear, misconception, misinformation, desperation, FOMO, hype, etc. Also, even if some people in some usages get benefit out of it, does not mean that fuels hype and snake oil to try to sell it to uninformed people to use in inappropriate places. Baking soda is good for making bread, lots of people use it for that with great success. It is snake oil for curing cancer, however.
- deleted 3y ago[deleted]
- r00fus 3y agoGiven the high-end art and luxury goods market has had a large use for money laundering, crypto targeting that market makes complete sense. That it happens to be illegal? Well that just requires some more ju$tification.
- yieldcrv 3y agoThe predominate usage of NFTs are non-art based. Insurance policies and market making use NFTs very heavily, especially after a BSL license from one market maker expired this year. And for art NFTs, much of the interest is from the collectors space or collector sentiment as these are an improvement in supply transparency and provenance in comparison to other mediums of collections.
- gexla 3y agoSnake oil is about the thing being sold, it's about the sales pitch. It's the people selling the product. An important snake oil trait is making grand claims which have little basis as fact, particularly with things which are difficult to understand or difficult to verify (if not impossible.) You can say anything about a product if the prospective buyers can't verify the claims. And so, the claims tend to get broader and flashier. Therefore, a snake oil sales pitch could still be applied to a highly useful product.