4 ms·
This type naysaying feels like clickbait. The current Tensor-fueled AI wave is easily on-par or exceeding in significance that of the Internet, personal computi
by xnx 3y ago
This type naysaying feels like clickbait. The current Tensor-fueled AI wave is easily on-par or exceeding in significance that of the Internet, personal computing, or the smartphone. AI is extremely hyped right now and very expensive, but the landscape is changing quickly. On top of a few immediately valuable applications: text generation, code completion, image generation, etc., there are a million people trying to figure out how to make use of "AI" capabilities that already exist. Even if the technology did not improve at all past GPT4, we would see a decade of innovation as it works through industries. A huge portion of any AI project is collecting and preparing data. Now that we know that datasets like this can be valuable, more effort will be put into collecting: business conversations of all types (customer service, consulting, meetings, etc.), diagrams, blueprints, photos and video from manufacturing, healthcare, and constructions. The value equation is also rapidly changing with dozens of non-Nvidia chip makers furiously trying to capture a piece of the pie, and economically motivated developers (compute time is expensive!) developing more efficient code.
- nathanaldensr 3y agoUnfortunately for you, we all heard the same exact promises and grand claims from people pushing previous hype cycles, such as VR, AR, EVs, cryptocurrency, Web 3.0, etc. Some people are addicted to hype.
- xnx 3y agoThey hype is definitely similar, but the situation is entirely different. You don't have to take anyone's hype/story about AI on faith. The future state is uncertain, but the current trajectory is clear and verifiable.
- kylebenzle 3y agoIn early 2020 I was doing a data science boot camp and one project was feeding in a bunch of scientific paper titles in a given area, then "predicting" a "next" future title, the idea was I could come up with ideas for future projects. What we have now is exactly the same except with a MUCH bigger training set. I am using GPT4 everyday but still can't believe the nonsense hype around it. ALL of AI would be lucky to generate a few $million a year of actual income for people. At BEST these LLMs are great spell checkers and code template fetching assistants but thats as far as LLMs on their own will ever go. Microsoft Word and Google Docs will have a built in "AI" spell checker that will dissapera into the background, and google search might get SLIGHTLY more relavent but thats it. No "AI revolution" is coming. I'd love to be wrong but looking at the details its hard to understand where people think this future revenue will come from.
- mechagodzilla 3y agoThe availability of the auto-text-firehose of LLMs will almost certainly make google search worse as it just gets overwhelmed with spam.
- cratermoon 3y agoWith all these models trained on a corpus of texts from the Internet[1], what's going to happen in 5 years when the internet is full of text generated after January 2022, the current cutoff data for ChatGPT? As an increasing proportion of training data is either pre-2002 or LLM-generated confabulations, when will it all collapse in on itself? Do these companies have any plans for how they are going to get accurate and factual input after their output dominates? 1. Corpora: https://commoncrawl.org/ https://commoncrawl.org/, https://www.english-corpora.org/ https://www.english-corpora.org/
- cratermoon 3y ago> the current trajectory is clear and verifiable. 2016, Geoffrey Hinton, "People should stop training radiologists now. It’s just completely obvious that within five years deep learning is going to do better than radiologists." https://www.youtube.com/watch?v=2HMPRXstSvQ https://www.youtube.com/watch?v=2HMPRXstSvQ
- xnx 3y agoGood example of the "peak of inflated expectations" from the hype cycle for emerging tech. Whereas crypto and Web 3.0 haven't broadly taken off (and would bet never will), AI is more likely going through a short and shallow "trough of disillusionment" before long steady gains.
- cratermoon 3y ago> short and shallow "trough of disillusionment" How many troughs is that now for 'AI'? Three? Four?
- kridsdale3 3y agoActual profit generation is the metric by which hype-fads should be judged. VR, AR, EVs (not sure about this one), crypto-mining if you are not just early in the pyramid, etc, have not generated profit yet. CRUD web apps have generated a LOT of profit.
- c-cube 3y agoYou're funny. Exceeding in importance the Internet itself? That's an incredible amount of hype. Would you rather have chatGPT dialed by SMS in a world without Internet, or Internet without chatGPT? I know which one I'd choose
- xnx 3y agoIt's a fair critique and an interesting thought experiment. Imagine a sci-fi alternative world where a smartphone-like portable device contained a compressed version all the world's knowledge (maybe a few petabytes?) and super-human intelligence (maybe 10x), but the highest level of communications was land-line telephones. It's not a slam-dunk that the world with high-speed Internet would be the superior one. Fortunately for us, we [almost] have both.
- adammarples 3y agoIt's a little hitchhikers guide
- xnx 3y agoI was considering using that analogy(!), but realized that our near AI future might be something that's closer to a combination of the Hitchhiker's Guide AND Marvin (50,000x smarter than a human).
- sshine 3y agoI can imagine a future in which people are not generally connected to the Internet, but rather to local GPU-powered bubbles that simulate it. Visiting the actual sites that the search engine summarizer references costs extra, but your subscription includes a wide array of websites ranked higher. Most people who are online visit the same few social media / streaming / news sites anyway. It seems like the high-quality LLMs that drive the hype train are not profitable, and the low-quality LLMs that you can run on consumer hardware and doesn't cost millions to train are not yet good enough to make money on.
- 3y ago
- m463 3y agoall new technology is overestimated in the short term, and underestimated in the long term. I remember when voice recognition was the big thing. Think era of "dragon naturally speaking" and similar. It was hyped, but practically speaking it was tedious and made lots of mistakes. And then over time it found niches like phone trees, and it gradually became better until it was accepted. Now AI is super hyped, but cars are driving themselves, closed captions are automated, people are getting assistance with art and writing, and chatbots are livening things up.