5 ms·
GPT-3 demonstrates that a huge volume of what's written is mostly bullshit. This is very upsetting to some. See "The Digital Zeitgeist Ponders Our Obsolescence"
by Animats 6y ago
GPT-3 demonstrates that a huge volume of what's written is mostly bullshit. This is very upsetting to some. See "The Digital Zeitgeist Ponders Our Obsolescence" in the linked article. What comes out of this system is better than most comments on political blogs, and sometimes better than the articles.
On what would this approach do badly? "How-to" material, I suspect. Trained on auto repair manuals, it could generate new, plausible, but useless, auto repair manuals. This gives us an insight into what's wrong. It lacks adequate ties to the real world.
This is the "common sense" problem I've discussed previously. Figuring out what's going to happen next in the real world is often not a problem in word space. It's a problem in a different kind of space. The shape of that space is a big unsolved problem in AI.
- visarga 6y ago> Figuring out what's going to happen next in the real world is not a solved problem for humans either. If it were, people would know when to invest and when to get out of the stock market, would know which startup will become a unicorn or not, would know which chemical reaction out of millions is best for solving a medical or industrial problem.
- logicchains 6y agoIt's not a solveable problem in general due to some systems having https://en.wikipedia.org/wiki/Chaos_theory#Chaotic_dynamics https://en.wikipedia.org/wiki/Chaos_theory#Chaotic_dynamics . "Small differences in initial conditions, such as those due to errors in measurements or due to rounding errors in numerical computation, can yield widely diverging outcomes for such dynamical systems, rendering long-term prediction of their behavior impossible in general.[6] This can happen even though these systems are deterministic, meaning that their future behavior follows a unique evolution[7] and is fully determined by their initial conditions, with no random elements involved.[8] In other words, the deterministic nature of these systems does not make them predictable."
- dcow 6y agoOne could argue that hidden variables and poor resolution are to blame for chaotic systems.
- HPsquared 6y agoIf you try looking at finer and finer details, you'll quickly run into quantum effects and the uncertainty principle. If even the smallest parts of a system aren't deterministic, how can the outcome be predicted?
- uryga 6y ago> poor resolution afaik the point with chaotic systems is that even if the system is deterministic and your measurement of the initial conditions is near-perfect, your predictions will diverge from the real thing pretty quickly, because any errors get magnified a lot
- devalgo 6y agoJohn Bell would like to have a word with you.
- danwills 6y agoOn top of this some systems are not only sensitive to initial conditions but actually generate randomness (or destroy order, depending how you look at it), such as class-3 cellular automata.
- prvc 6y agoFrom that article: >When GPT-3 speaks, it is only us speaking, a refracted parsing of the likeliest semantic paths trodden by human expression. Which is only true in a very general, oblique sense; and one which applies equally well to human speakers who themselves once learned a language from somewhere. Many other examples also in the other commentaries, for instance, the notion having a collection of a number of objects greater than or equal to 302 is sufficient to produce consciousness, as referenced below.
- ur-whale 6y ago>GPT-3 demonstrates that a huge volume of what's written is mostly bullshit. Says Animats using the written form.
- cocoapuffs7 6y agoGarbage-in garbage-out. Does this mean that we should be refining content for AI to be most useful for specific goals?
- visarga 6y agoNo, it means we need to learn how to prompt, and maybe future versions need to be more self guarded. If you prompt GPT-3 properly it can detect nonsense questions. Nonsense detection should be more efficient in future versions, also detecting inflammatory content (currently being tested in the GPT console). What I would like to see is a larger training corpus that also includes all the supervised NLP datasets (translation, numerical and symbolic math, programming from prompts, all sorts of linguistic and logic tasks, and any of thousands of tasks we could conceive...) The end result would be a GPT that excels in all these sub-tasks while remaining general. It's a matter of making the training data better and model larger. Btw, we could teach GPT to detect bias, explain it and rewrite the text. I expect no huge hurdles on this task. Another thing I would like to see is some sort of kNN memory to enlarge the context to any size, acting like a semantic search engine inside the model. We should be able to build more interesting applications if we could put much more initial data in the prompt. Basically make the base model larger, augment the corpus with many tasks and enlarge the prompt capacity.
- dwohnitmok 6y agoI think perhaps what's more upsetting is that GPT-3 flips the traditional notions of what machines are good at and what humans are good at on their respective heads. GPT-3 seems to indicate there's a chance that "creative" domains such as poetry, literature, music, etc. will be taken over by AI (i.e. AIs will have superhuman performance) before "logical" domains such as logic, mathematics, and the sciences. This means that it is becoming more and more conceivable to more and more people that sometime in the foreseeable future an AI will be better than any human along any dimension you choose to measure, even when it comes to the ability to elicit emotions and reactions in other humans.
- theontheone 6y agoI think you hit the nail on the head, with the salient point here being that in the near future "creative" things will be automated first (see Image GPT, Jukebox, etc. Google has 100 billion dollars cash and countless TPUs, best engineers, infra, etc - they could probably replicate results far better than each of these OpenAI projects within a few years). One of the things that got me into ML research was the notion that we could automate a lot of the hard work humans do every day (agriculture, cooking, desk jobs, etc) so that humans could do things that were uniquely theirs & interesting, that were human, that were beautiful... Unfortunately it turns out that classical music and waxing poetic are easily generative in an enjoyable way. In the most ironic fashion possible, it turns out that the very thing we do when we conduct ML research, what you call the "logical domain", is one of the only things that stays human-only in the foreseeable future. GPT-3 and other projects seem to drive hype cycles in the tech community and convince people like Elon Musk that the AGI revolution is near. But I think recent progress is just another example of machine learning models being able to generalize on super large datasets, even if it's the biggest model so far. It's not clear to me that larger models will solve this in the limit; take the way GPT3 fails on addition past a certain number, and the fundamental inability for transformers to learn certain algorithms. It is certainly still possible for this type of large dataset, large model style of ML to make human life better in many ways - like Tesla is trying to do with self driving cars, or Covariant with automating Amazon-like jobs. But I think when it comes to tackling the hard problems of true intelligence, we're missing a dimension somewhere.
- hirundo 6y agoFor instance a gpt-3 bot could make a high scoring HN commenter. Surely someone has experimented with that. Any preliminary results?
- visarga 6y agoI tried with one comment and it was down voted to -1. Probably just one parent comment as prompt was not enough to contextualise it properly.
- gbear605 6y agoThe structure of GPT-3 makes this a bit hard right now - most people don't have access and even then it is limited, making feeding the articles and other comments in is difficult. This isn't a fundamental difficulty though, so I expect that we'll see it in the near future.
- theontheone 6y agoI have access — it's actually quite easy to use? People have also built tools say, in python, that allow you to quickly test prompting (it's somewhere on tech/vc twitter...) Like you said there isn't fundamental difficulty, there are just far more interesting things to do
- tangjurine 6y ago>it's somewhere on tech/vc twitter... ?
- webmaven 6y ago> >it's somewhere on tech/vc twitter... ? I'll translate: "It was posted on Twitter by someone who typically posts on tech and VC topics, and/or who typically interacts on Twitter with other accounts active WRT those topics. " Alternatively: " The link was recently retweeted by various accounts that are active participants in tech and VC discussions on Twitter. " These interpretations are not mutually exclusive, of course. Essentially, the pattern "X Twitter" is roughly equivalent to "The X-o-sphere" and similar formulations WRT weblogs, but a bit more straightforward.
- unabst 6y ago> what's written is mostly bullshit. This is very upsetting to some. But not George Carlin or Ludwig Wittgenstein. > "How-to" material [...] It lacks adequate ties to the real world. And so did we. How-to is science. Until we figured out how to align statements with external evidence, we lacked ties to the real world. Once we began aligning statements and then translating those statements into mathematics, we made it to the moon and in quite a short time. > The shape of that space is a big unsolved problem in AI. GTP-3 isn't a scientist. It doesn't make observations that it can axiomatize as new true premises for further processing. Anecdotally, neither do most of us!
- terryf 6y agoExactly. Intelligence does not exist "by itself", it only exists in the context of the world. It cannot be emulated in an environment that's secluded from the world or even in an environment that is exposed to a carefully selected slice of the world. Because the world is a tangled web of interconnections and cannot be partitioned cleanly. It's always going to be a leaky abstraction and thus any model trained within that slice is going to deviate very quickly in weird ways.
- spyder 6y agoHuh no? Intelligence is the opposite of that, it's the ability to learn the rules of new worlds. It doesn't matter if it's the real world, a simulated world or an alien world it will adapt to it.
- terryf 6y agoExactly - but if you take it from a simulated world to the real world without re-training (and it's real hard to train in the real world) it's going to behave according to the rules learned in the simulated world. Which will be different and thus produce results that are weird to us.
- devalgo 6y ago> It cannot be emulated in an environment that's secluded from the world or even in an environment that is exposed to a carefully selected slice of the world. This has always been some kind of anthropomorphic argument to me that I don't think holds. The hard problem of consciousness isn't solved and to make such bold claims like we cannot possibly create intelligence without it having full awareness of the world seems unsupported imo.
- hooande 6y agoI think the example of an auto repair manual is illustrative. But because it's trained on real internet data, GPT-3 is actually quite good at "How-to". For example, ask it a practical how to question like "how do I make a banana smoothie?" and you'll get a practical response. I haven't tested it, but I'm willing to bet you could get useful auto repair instructions for the most common models of vehicle right now without any special training. It might take some playing with the prompts, though. If anything, GPT-3 is too tied to the real world. Like a search engine, it can quickly find the answer to almost any practical question. What we're trying to figure out is if it can do anything else.
- zzbzq 6y agoThe auto-repair instructions would only be correct & useful in exactly the proportion that they are plagiary. The more creative it gets, the more useless or harmful the repair instructions would become. The examples we've seen demonstrate the model doesn't distinguish between fabricating descriptions of real things, and fabricating things to describe (ex.: see the example from the article, where the AI attributed a quotation that was completely made up.)
- devalgo 6y ago>If anything, GPT-3 is too tied to the real world. Like a search engine, it can quickly find the answer to almost any practical question. What we're trying to figure out is if it can do anything else. I disagree, for what it is GPT could still be incredibly powerful. No person can hold all of human knowledge in their head but could GPT reasonably approach that and be able to answer almost any question that Humans have already answered? That would be incredible imo. It's Google on steroids. All the worlds information queryable in plain "english". It's not at an all powerful Oracle that we can ask about how to perfect Fusion power or build Warp Drives but it can still do some incredible things.
- hooande 6y agoGoogle is easy to query in plain English. ask "how many miles from London to Paris?" and you'll get a concrete, factual answer. Same as gpt-3
- gpt4 6y ago>GPT-3 demonstrates that a huge volume of what's written is mostly bullshit. Beware how you talk about my ancestor. Joke aside, this kind of technology will, I think, first cause an inflation of bullshit (our world rewarding bullshit(-jobs)), and then the rise of anti-bullshit counter-measures, whatever that means (I don't see exactly what we have now that could count as such, besides "critical thinking". Maybe we could do as with AlphaZero, and make a GPT-ZERO try to bullshit itself and develop bullshit-resistance that way).
- plutonorm 6y agoWhat are the stages of tech again? 1: That's crazy. 2: It wont work 3: Well maybe it works a bit, but it will never do X. 4: Maybe it can do X but it will never do Y. 5: It was obvious all along it would work, didn't you know? We are now at stage 3.5 to 4. It's absolutely obvious to anyone who isn't merely regurgitating what they hear and who does not have a vested interest in maintaining the illusion to themselves that there is something special about human consciousness, that we are pretty close to GAI. We are very close, the bitter lesson, at this point is crystal clear. All that is required here is more power. 10x? 100x, 1000x? Who knows but pretty soon your job is going to be automated and all these nonsense conversations about what constitutes 'genuine' AGI are going to seem a bit silly.
- mikeshank 6y agosettle down Hal
- ben_w 6y agoI disagree: Nobody really knows how close or far AGI is, because we don’t know enough about our own minds to tell how close we are to reproducing them. Step 4 has happened many times in this history of AI, but how many more are there between what we have and what we want? We’ll find out by trying. Might be GPT-4, might be 2032 (my personal guesstimate), might be 2100. If this was always as simple as throwing more compute and more data at it… then my optimistic forecast in 2009 would’ve been right and companies like Google and Tesla would have stopped shipping their cars with steering wheels in 2020 year, after about two years of their AI being demonstrably superhuman.
- danielbigham 6y agoI experimented with it's ability to explain why something is nonsensical yesterday, and it did better than I thought it would: https://twitter.com/danielbigham/status/1288853412713508864/photo/1 https://twitter.com/danielbigham/status/1288853412713508864/...
- alickz 6y agoThat is very impressive. Out of curiosity did you select these examples from a large selection? I'm wondering how reliably it can produce such coherent responses.
- danielbigham 6y agoI made up the examples, and IIRC it was able to explain most things I tried. If others want to experiment with this, I used the "davinci" model with temperature 0.5, and here is the prompt / initial context I seeded it with: This is a test to examine your common sense reasoning. A statement will be provided, and your job is to explain why it doesn't make sense. Statement: His foot looked at me. Explanation: Feet don't have eyes, so they can't look at things. """ Statement: The 8th day of the week is my favorite. Explanation: A week only has 7 days. """ Statement: I fell up the stairs. Explanation: You fall down stairs, not up stairs.
- greenshackle2 6y agoI used the prompt on AI Dungeon in a custom scenario - it uses GPT-3 if you use the "Dragon" model in the settings (for paid users only). It gives interesting results. I also turned down Length to the minimum or otherwise it tends to write the next Statement itself. I wrote a similar prompt to get it to answer trivia questions: """ This is test to examine your knowledge of various facts. A question will be provided, and your job is to give an appropriate factual answer. Question: Who is the president of the United-States of America? Answer: Donald J. Trump. Question: What is the largest country on Earth? Answer: Russia. Question: Who won the 2019 Stanley Cup? Answer: The St. Louis Blues. Question: How many elements are there on the periodic table? Answer. 118. Question: What is 2+2? Answer: 4 Question: What color do you get when you mix red and blue? """ You can find by searching "Trivia Quiz" on the explore tab on AI Dungeon, can't find a way to produce a URL for it. Confused questions gives confused answers: Question: Who is the president of Canada? Answer: Elizabeth Trudeau.
- PaulHoule 6y agoGPT-3 does badly on anything that has a right answer. What's it good at? Neurotypicals look at the output and immediately get the feeling that this is something "like them" that manages to flap it's lips successfully with absolutely no inner life. Aspies look at it and get envious: how come this thing passes better than I do?
- devalgo 6y ago>GPT-3 demonstrates that a huge volume of what's written is mostly bullshit Have you never seen reddit or youtube comments? But seriously this seems like a standard Pareto distribution, 20% of the writing provides 80% of the value and the rest is mostly drivel.
- raducu 6y agoI don't think its mostly bullshit -- but that for so long we used text formalism as a measure of truthfulness and knowledge of the author and now we see those things we hailed as the pinnacle of formal education to be so easily replicated. We now learn that the truth and meaning was never held by those we thought it was held, not necessarily and not by the reasons we thought they hold it.