6 ms·
In the battle between Microsoft and Google, LLM is the weapon too deadly to use
- est 4y agoLLM is not only a service, it shook the fundation of Google's vision. https://www.google.com/search/howsearchworks/our-approach/ https://www.google.com/search/howsearchworks/our-approach/ > Google’s mission is to organize the world's information yeah but you only organized the info, but GPT-3/ChatGPT was the first of is kind to actually "understand" the information.
- gooseus 4y agoI'd say that LLMs are a different way of organizing the world's information through a kind of lossy compression into enormous probability distributions that can approximate the original information with enough fidelity to be useful for a lot of low-stakes applications.
- donkeyd 4y agoThat was a lot of information compressed into a single sentence, but I think you hit the nail on its head. Most things I read about ChatGPT makes me think that most people don't understand what an LLM really is though and make assumptions on what it can do and what it 'understands'.
- jacquesm 4y agoThat's because people look at what it can do rather than what it really is. Maybe what it really is doesn't really matter all that much except to 'AI purists'. But to the rest of the world if a company markets something as 'AI' they will treat it as such, including calibration of their response to the effects of that technology independent of how it works under the hood. Whether your job gets obsoleted by LLM or AGI doesn't really matter to people who couldn't tell the difference between the two and it shouldn't matter to them. Their voice deserves to be heard in this whole debate but the tech world has decided they don't really matter.
- wrs 4y agoIt’s worse: they look at what they anthropomorphically think it’s doing. Like looking at an animal picture classifier work and thinking it can see animals, or a watching a self-driving car and thinking it has some kind of simulation of a human driver in it. I think the “AI purists” need to make a lot more noise about the fact that nobody knows what LLMs are doing.
- daniel_reetz 4y agoThere's a term for this anthropomorphic error in the neurosciences/psychology - a homonculus. Like your theory implies there's a little man in there doing the work. (homonculus also has other meanings in neuro, including cortical mappings, just sayin)
- _0ffh 4y agoWhen I was doing my master's thesis, my industrial supervisor opined that a neural network "is really just a glorified lookup table". I think, given the succinctness of the characterisation, it's not too far off the mark.
- pharmakom 4y agoYeah this is a great description. People are saying it's a "lossy jpeg" in a way that is disparaging and minimises how awesome LLMs actually are! They are a form of text compression that leverages the semantics of the text! Amazing!
- jacquesm 4y agoAnd can approximate combinations of that information (hopefully with enough fidelity) that weren't present in the original training body. This is where the value lies, if all it did was spit back out what went in it really would be just a compression algorithm.
- oh_sigh 4y agoBesides for the fact that current LLMs don't understand anything, being first isn't part of that statement. Google also wasn't first to have a search engine, or a video sharing site, or an ad exchange, or an email service.
- xnx 4y agoYou left out the other 2/3 of the mission statement: "...and make it universally accessible and useful."
- est 4y agoyeah the second half gets interesting. Making it accessible is not enough, LLMs can intepret it in different ways.
- MAGZine 4y agoI'm not sure if that's the case or not. In 2017 I could ask Google which episode of the Futurama was the one where the save the planet from a trash ball, and it could answer the question in natural language. I suspect that Google X has had these, and other capabilities for a while even if they've never been shipped in any specific product. Or how about Duplex, where Google could call a restaurant to make a reservation, including negotiating times? That was also like 2017-2018. These are only the public, polished, productized ideas. Google has bard, a response to chat gpt, probably only because they didn't realize that people actually wanted a chatbot. I think it was a product failure. How quickly they responded with something similar I think shows you this tech exists inside Google already. Remember, OpenAI was created in part to help make AI accessible to people outside of Google/Microsoft. Who knows what's going on behind closed doors.
- shostack 4y agoI don't know that it ruined it. However it creates a challenge for search which makes previous iterations of SEO spam look like child's play. So the signal to noise ratio is going to get massively worse. And if they don't give strong signal to users and continue with an experience increasingly suffocated by ads, users will go wherever the AI prompt is embedded with the least friction in their UI with the minimum acceptable results. Which makes Microsoft relevant again because they own the lower level UI experience on a staggering percentage of screens. I'd expect nothing but aggressively shoving clippy 2.0 into every surface Microsoft owns. And I expect they will be very light with the ads because they have the additional revenue streams to play a longer game on this if it hurts Google's market share. Google doesn't really have the same luxury.
- aftbit 4y agoIMO there is too much gnashing of teeth over AI safety at the moment. LLMs are not (currently) AGI, and their "alignment" is not yet critical. Of course new powerful tools will have both positive and negative impacts, but this is not different from any other tool. Unlike atomic bombs, there are a plethora of legitimate uses for these tools that do not involve destroying anything or killing anyone. One does wonder what the analogy to "radioactive fallout" will be from LLMs. The obvious guesses (greater propaganda and internet spam) are likely shortsighted.
- Archipelagia 4y agoI think the entire idea behind safety is to start worrying before it becomes critical. Similarly with Covid, the right time to start worrying (on a societal level) was before the disease becomes widespread. The tragedy of that means that if you take the correct action at the right time and succeed, you will always look like you were overreacting.
- LawTalkingGuy 4y agoThe proper solution is to have a plan (with contingencies, etc) and follow the plan. Otherwise the solution is guaranteed to be political and thus stupid. Politicians are going to be worried about perception of the appropriateness of their actions, not the correctness of those actions.
- donkeyd 4y ago> what the analogy to "radioactive fallout" will be from LLMs I think we're already seeing it. People don't understand that an LLM is just a text generator and add value to what the LLM says. See the article below for such an example. https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-a...
- waboremo 4y agoHorrifying story, it really doesn't take much, and I'm sure a lot of people feel the same way to "Pierre" in the article - overwhelmed by all the catastrophic news and events. As I was reading that, the image where "Eliza" describes methods of suicide was so bizarre to me. I thought what an absurd tone change bordering on dark comedy, and then caught myself, I was doing exactly that adding value and assumptions based on online human interaction to a "text generator". It's going to be an interesting experience as more LLMs become humanized, by naming them, using 3D models or preset video animations, text to speech generation, more personalization to the prompt creator, etc. and that line becomes increasingly blurry for folks.
- cwp 4y agoYawn. Tech bad, yet again.
- anybodyz 4y agoI think the consensus at this point is that these models are much closer to AGI than anyone thought they could or should be, and that the delta between what we have now and AGI is smaller than it's ever been. Anyone who tells you that these models are "just glorified text generators" is flat out wrong and hasn't bothered to do their homework. And anyone who claims they "know how it works under the hood" is making claims that all of the true experts have notably carefully avoided making.
- unshavedyak 4y ago> Anyone who tells you that these models are "just glorified text generators" is flat out wrong and hasn't bothered to do their homework What homework.. if i may ask a dumb question? My very limited understanding was such that this is a glorified text generator - however, it seems what is possible with text generation is allowing unexpected levels of competence and utility. To be clear, i agree with you that it's functionality is impressive and deep. However i had figured one area of research is in the very premise of "How good can LLMs without intelligence be?". Is that wrong in your view? (again, i'm not making a statement. I know next to nothing in this space. I just try to reach a layman's understanding on this subject and i use GPT4 daily)
- kobalsky 4y ago> How good can LLMs without intelligence be? after this LLM breakthrough a lot of smart people started questioning what intelligence really is.
- daniel_reetz 4y agoI was extremely skeptical, but after playing with these things and listening to discussions held by their creators, I'm fairly convinced that this is intelligence-adjacent. In the same sense that there must be thoughts an organic brain can't think, there are types of intelligence that don't map exactly onto ours. Vaguely like Feynman's peculiary methods of doing integrals - his method was different, so he could solve things unsolvable by people with standard methods.
- glitchc 4y agoIt shouldn't be surprising that we see a proliferation of negative articles on LLMs in the media. Much of the reporting is self-serving, with reporters trying to protect their livelihood. Among others, LLMs outright replace journalists, especially those reporting on science and technology. Why pay a human money to understand and report on something when ChatGPT can generate a digest for pennies on the dollar? I find LLMs fascinating, and do not perceive them as an existential threat on par with nuclear warheads. Rather I see it as a liberating mechanism. Llama.cpp lets me run a Googlesque search on my local hardware, no connectivity required. That's incredibly exciting!
- blackbear_ 4y ago> I find LLMs fascinating, and do not perceive them as an existential threat What do you think of this? http://arxiv.org/abs/2303.16200 http://arxiv.org/abs/2303.16200
- paddw 4y agoThere are many reasons to be nervous about AI, but this line of argumentation seems unscientific.
- blackbear_ 4y agoDoes "unscientific" mean "unworthy"? Is it even possible to be scientific when evaluating innovations?
- paddw 4y agoUnscientific implies there is no reasonable experiment to be able to evaluate a hypothesis. Generally, it is very much possible to conduct scientific experiments on innovations, and even LLMs can be tested to a degree by comparative evaluation and other techniques which OpenAI has used. What can not be tested, and therefore is not scientific as I see it, is a broad and analogical train of argument which tries to understand the development of AI through something like natural selection. There may be some value in trying to think of things this way, but to my mind, that kind of argument should not be made in an academic paper.
- pjkundert 4y agoInvestigative journalism isn't at risk from LLMs, which simply regurgitate the consensus view of their datasets. This is an excellent tool in the arsenal of a real journalist. What I would like to know (and what few if any of the whining "Journalists" are investigating), is: Exactly what biased filtering is being performed: 1) On the input datasets used in various LLM training, and 2) On the "guard rails" enforced on LLM output (ie. the target of the various jail-breaks that prevent LLM's true outputs being perverted by the LLM's owner) LLMs trained, restricted and run by these huge, clearly biased organizations are inherently untrustworthy, in my opinion. Unfortunately, no "Investigative Journalists" are interested in providing useful insights in this critical area.
- abeppu 4y agoI want to call for a global pause in premature hyperbolic freaking out about LLMs. The scope and breathlessness of people's opining about these systems poses real and urgent risks to the public. Both "maybe it's the beginnings of AGI" and "that means maybe it's the beginning of skynet" are not constructive. Because many of these opinion pieces are speculative, they are inherently not based in fact but can scare and distract people, and hinder proper investigation and responses to more material risks by regulators. Posts which cherry-pick successful interactions with LLMs _without awareness of its training data_ may convince humans to inappropriately trust outputs from these models. Posts which cherry-pick interactions in which these models display poor behavior may inappropriately convince humans that their are somehow worse than human-produced content sourced from the world-wide misinformation-swamp and social media harassment cesspit. Please, all tech-spectators and commentators, let's take 6 weeks to gather facts, put things in perspective, check your local library for paper books about nuclear physics, read some Hubert Dreyfus, and resume publishing when it can be done in a responsible and fact-based way.