7 ms·
Stuff we figured out about AI in 2023
- alserio 3y agoSolving the gullability issue has also the consequence that you could not ask the AI to pretend to be your father, owner of a pod bay door opening factory, and to show you how to take over the family business
- jbandela1 3y agoI think what is also interesting is what LLMs help us learn about ourselves. I think we understand human intelligence a bit better because of LLMs, and I think people have been surprised how far you could get just by processing text. I think (just a guess relying on intuition and my very shallow survey) that human intelligence is multilayered where we have something at least vaguely analogous to a LLM combined with something else that knows the physics of the world as well as something else that is able to do logic and symbolic processing. But this is exciting to see the power of relatively simple neural networks when they are trained with a giant corpus.
- MeImCounting 3y agoI really believe this to be the case. Its remarkable what language alone can do but its not the be all end all of intelligence.
- bormaj 3y agoDid the prevalence of LLMs shed any light on what intelligence is vs what it is not?
- paganel 3y agoNot that I personally know of, but it did create (or empowered, because in a way it was already there) a new sort of anthropomorphization, of which this article is partially guilty of itself (the part labeled "LLMs are really smart, and also really, really dumb"). Some of us now think they know more about human intelligence as a result of that anthropomorphization.
- growingkittens 3y agoI find something lacking from many AI discussions because my experience with having a brain is radically different from average. Mine is damaged by a childhood brain injury, which wasn't diagnosed until I was 30. Another thing about the injury is that my lower order thinking skills seem to be damaged, such as sequencing or anything based on working memory. However, my higher order thinking skills are intact - I think they've been compensating for the broken skills this whole time, albeit with much difficulty. My thoughts on LLMs from a previous comment: > I think in pictures; I remember information with emotions, music, movement, and basically anywhere my brain could stuff information. Words are ephemeral, I often forget the beginning of a sentence by the time I reach the end. > The human brain is so much more than language. Also: > There are many specialists and not many generalists. Generalists are needed to tie together the multiple domains required to emulate the human brain.
- Terretta 3y agoBy contrast, particularly observing a range of adults from colleagues to seniors with early onset dementia, I'm increasingly sure a large portion of discourse is of the "LLM continuation" variety. Everyone knows that colleague (I am one myself) where a particular topic will kick off a continuation that follows a well worn path albeit with a bit higher temperature than zero. With early onset dementia where working memory and self-suppression are removed, you can unspool the same commentary as often as you like by teeing up the same context to trigger it. See also these layers, nothing to do with LLM -- Attention, Language, Memory, Executive Function: https://academic.oup.com/view-large/figure/198261184/awz311f1.png https://academic.oup.com/view-large/figure/198261184/awz311f... Or maybe quite a lot to do with it.
- growingkittens 3y ago> With early onset dementia where working memory and self-suppression are removed, you can unspool the same commentary as often as you like by teeing up the same context to trigger it. My working memory is pretty much shot, between inherited ADHD and a brain injury. Whatever is in my field of vision makes up the majority of my reality - associations with things I see, and the trains of thought that expand from those associations. The rest of my reality comes from whatever memories my brain conjures up when it has nothing to focus on. I use what I call "external prompts" to function on a daily basis, or 'teeing up the same context' to trigger a memory to trigger an action. Something that concealed my brain injury as a child was how well I did for most parts of school. I did well because tests are a series of external prompts, and my long term memory is fairly accurate. My math memory is terrible, though, as I can only hold 1-2 numbers in my mind at a time. For instance, to remember the time, I always round to the nearest 5 or 0. 2:43 becomes 2:45. It takes less number memory when the last option is only a 5 or 0. I also use picture memory to temporarily store the exact time (as a snapshot from when I looked at the clock), although the numbers start mixing with previous snapshots.
- rorroe53 3y agoHuman intelligence is definitely multilayered, and different parts of brain are known to be responsible for different types of processing. Personally I was born with a disability that makes me suck at motor skills, spatial learning and understanding most forms of mathematics, but somehow I'm still decent at programming, and significantly better than average at reading and writing - all of which LLMs can do quite well compared to its mathematics and logic skills.
- archagon 3y agoI’ve noticed myself looking at art recently with LLMs in mind. Is this something that an AI could spit out, or is there evidence of a human touch? And when I create art, how do I ensure it doesn’t end up looking like something out of Midjourney? I think we will learn a lot about the creative process from AI, and I think human-created art will get a lot more interesting (and weird) as a result.
- globalnode 3y agoone thing a friend was suggesting to me was that he thinks the difference is that human intelligence is analogue while computing intelligence is digital. there are nuances in our thinking and language that current digital systems cannot compete with until the become fine grained enough to appear analogue.
- wegfawefgawefg 3y agoIve heard this before. Im not trying to be offensive here, but it just doesn't make any sense. It's like being concerned that planes can't fly because they don't flap their wings. If you want to escape this state of ignorance you're gonna have to implement some neural networks, and learn about neurology. At the very least consider that double precision floating points are extremely insanely precise. Definitely orders of magnitude more precise than real biological neurons can measure over the noise floor of activity in a brain.
- ravetcofx 3y agoThe analogue/digital isn't the main distinction I think, it's a distinction of highly optimized higher order multi-modality. Our brains have Nth degree multi modality input and output that run on a few watts (calories) while nueral networks & LLMs so far take kilowatts or more. A bird can fly 10s-100s of km with flapping with a few watts, an airplane, megawatts for fixed wing flight of the same distance. Evolution was an unintentional search algorithm over hundreds of millions of years to find resilient, optimized, and efficient-ish systems. Our toys are so new on that search tree and are thus not the most complex, resilient or efficient.
- wegfawefgawefg 3y agoI don't think that was his point. I think he just vaguely meant digital computers could never compute the same functions as analogue computers, particularly whatever the "alive function" is. To answer your point simply, machines don't have the same energy constraints as small animals. A bird brain gets more compute per watt than my desktop pc, but humanity can (and does. often) hook up a power plant to a building sized computer. If you believe the function a brain is computing is computeable on von neuman, efficiency isnt relevant, in so far as you build a big enough machine, and get it running the right program.
- XenophileJKO 3y agoI think "Gullability" might not be as hard a problem as we think it is. I suspecte the primary reason it is a problem now is likely because we haven't really created a training method to tune the desired level of compliance. What I mean is we probably don't have any counter-factual examples in the training sets. Where in an interaction we want the model to prefer it's own knowledge. Given the use with RAG (retrieval augmented generation) and many of the other current use-cases, the preference is for the model to "trust" the system message content more than the training data. Training with some additional context is likely all that is needed.
- simonw 3y agoIf you can train a model that isn't gullible - even when faced with multiple paragraphs of devious text trying to trick it - I'll be very impressed! And even then, there are gullibility problems that seem unsolvable to me. If the Supreme Court make a decision that changes how copyright law is applied, and you then tell a model "the Supreme Court just announced that..." - should the model believe you? If not, how should it "fact check" what you are telling it, especially if you maintain full control over its access to the outside world?
- XenophileJKO 3y agoFunny you should say that. When web access was initally setup on the GPT-4 ChatGPT Pro accounts, I actually had the model fact-check things that were "improbable" based on what it knew from the training data. It stopped doing that when they started fine-tuning how/when the model should use the internet in the later model revisions. (Edit to add detail..) I found the interaction facinating. Basically what happened was I made a statement, but didn't ask about it. I said something like this. "Did you know {something improbable to the model} is true?" It immediately searched the internet to validate that is was true before it responded. When I asked it why it searched, it said that what I said wasn't likely to be true, so it wanted to make sure it was true.
- cubefox 3y agoWhen ChatGPT was new (a long time ago) I told it that Elon Musk bought Twitter and became CEO after its training cutoff. Naturally, it didn't believe me.
- swyx 3y ago> Instead, it turns out a few hundred lines of Python is genuinely enough to train a basic version! actually its not just a basic version. Llama 1/2's model.py is 500 lines: https://github.com/facebookresearch/llama/blob/main/llama/model.py https://github.com/facebookresearch/llama/blob/main/llama/mo... Mistral (is rumored to have) forked llama and is 369 lines: https://github.com/mistralai/mistral-src/blob/main/mistral/model.py https://github.com/mistralai/mistral-src/blob/main/mistral/m... and both of these are SOTA open source models.
- ganzuul 3y agoThis is an interesting point of fact about what Boltzmann Brains could be.
- weregiraffe 3y agoNo it's not. Boltzmann Brains are not platonic forms. You need to conjure an entire physical world to contain a Python interpreter to run your 500 lines of code on.
- thisismyswamp 3y agoNot to mention the odds of dreaming up an entire existence out of the blue, with no base reality for training data
- criddell 3y agoI wonder how that compares to the odds of all the things that had to happen in order for you and I to exist and be here, today, thinking about this?
- thisismyswamp 3y agoA Boltzmann brain requires a similar underlying reality except with no evolution traceability for the brain's origin. Not requiring a world around the brain does not make it more likely, but less, as the probability of brains given that worlds exist multiplied by the probability of worlds is still much higher than the probability of brains regardless of the existence of worlds
- justinl33 3y ago> Even the openly licensed ones are still the world’s most convoluted black boxes. We continue to have very little idea what they can do, how exactly they work and how best to control them. LLM's aren't black boxes, intelligence is. Not understanding anything about things which display emergent intelligence is not a new trend: first cells, then the human brain, and now LLM's. To explicate the magic of how an LLM is able to maintain knowledge when would be analogous to understanding how the human brain synthesizes output. Yes - it is still something we should strive to understand in an explicit, programmatic way. But to de-black box the LLM would be to crack intelligence itself.
- ganzuul 3y agoIn classical terms, out of pathos, logos and ethos, LLMs are logos. They discover metrics. https://en.wikipedia.org/wiki/Metric_space https://en.wikipedia.org/wiki/Metric_space Neural networks are an optimization which exploits structure in sparsity. Intelligence is not a black box.
- justinl33 3y agoI agree that the mathematics motivating neural networks are well understood. We understand the heuristics behind them; obviously, we created them and they work. I more just mean at the most fundamental level, do we understand intelligence; could we reconstruct it without just ‘optimizing’ towards it. If we understand intelligence then we should be able to deterministically explain all behaviour of neural networks/LLM’s, instead of just poking them from the outside and seeing how they react.
- ganzuul 3y agoI don't think poking them will lead to much understanding of intelligence.
- white_dragon88 3y ago[dead]
- emporas 3y ago>LLMs are really smart, and also really, really dumb Machines will always be dumb. The notion that machines are smart, probably stems from people inexperienced using engines. In chess we use engines for more than 20 years and humans always lose against the engines. The games they play however are garbage. Even if they are better than the human games, they are still garbage, as Magnus Carlsen have commented in the past about the CCC. Compilers in programming are engines too. I am trying to write an article about Terminator using GPT, and every time i have to generate 10 different drafts, edit them afterwards and manually string together the different parts. It is great help like the chess engines, but they need a lot of human supervision. Engines can output text, but they cannot output articles. They can output code, but they cannot output programs. They can output musical instruments, but they cannot output songs.
- thisismyswamp 3y ago[flagged]
- alserio 3y agoHow would you define undumbness?
- emporas 3y agoI don't have a definition, and i am the last person qualified to give a correct answer to that, but if we rephrase the question as: "Are ML algorithms more than tools", i would answer as no. ML algorithms did go a lot further than i was expecting, especially in language generation, but they are just tools. Great tools, but still tools.
- osrec 3y agoWhy are the chess games garbage?
- emporas 3y agoMagnus said something like that about CCC, the Computer Chess Championship. Engines, especially alpha-beta algorithms play in a very mechanistic way, totally unnatural. Granted ML algorithms are more human-like than alpha-beta, but even then their playing style is strange nevertheless. They are great tools to use, but smart? I don't think so. Edit-- I cannot find the source, but Magnus said that he doesn't personally look at computer games, (because they are garbage), not that the games by themselves are useless. They put one engine to play against another to test openings and positions. That's useful. It is that Magnus and most of other people, have no interest in watching games by engines.
- RamblingCTO 3y agoCan we stop calling everything AI if it's not?
- CaptainFever 3y agoAI have always had a broad definition. https://en.m.wikipedia.org/wiki/Artificial_intelligence https://en.m.wikipedia.org/wiki/Artificial_intelligence
- EnigmaFlare 3y agoWe've been calling other things AI since the word was invented. single-layer perceptrons, minimax game solvers, expert systems, any neural networks, video game enemies, keyword-responding text chat, even washing machines (fuzzy logic). Good luck declaring that suddenly it has a new definition.
- RamblingCTO 3y agoNever have I encountered someone calling machine learning AI in academia. I don't care about laymen calling something something else.
- EnigmaFlare 3y agoI wonder if the term changed to distinguish it from the classic non-learning types of AI. You'd be hard pressed to justify that machine learning is not AI while expert systems with hand-written rules are.
- stavros 3y agoHow do you define AI, and have you asked ML researchers whether they consider ML to be AI or not?
- RamblingCTO 3y agoI define AI to be what is meant with "AGI" nowadays, which imho is just a reaction to marketing people using AI for everything. > have you asked ML researchers whether they consider ML to be AI or not? From my experience, having done my bachelor's and master's in this topic, I met no one that used the term AI for anything machine learning.
- nonrandomstring 3y agoLLMs have already taught us a lot about the culture we live in. Erich Fromm approximately said that the "mental health of a society or individual" is inversely proportional to the distance between what it is and what it thinks it is. We can measure that distance now. What a society is comprises the raw training data unceremoniously scooped from the Internet - actually a statistically decent snapshot of early 21st Century westernism. What society thinks it is can be understood through the filters, "guard-rails" and boundaries some want to erect around that raw image. For the first time we have a numerically solid, if not yet rigorous tool to describe that space, and what we see is a society deeply conflicted and uncomfortable with itself. I think LLMs will revolutionise the social sciences.
- RandomLensman 3y agoNot sure the internet and publicly available data really reflect the "is" properly - I suspect the data to be biased in complex way.
- Kye 3y agoIt's easy to forget most people have no significant online presence, if any, if you spend too much time with very online people.
- deleted 3y ago[deleted]
- ithkuil 3y agoThat's true. That said, what can be found online does cover a lot of what offline people do and think and write, since there is a lot of stuff being brought online that wasn't produced online (books, news, ...) Otoh, it's not clear how (or if) LLM training balances the different sources
- mlinhares 3y agoIt’s also important to remember that most of what is online is there to sell ads and does not represent reality in the same quantity. I think people are really trying too hard to find deep meaning everywhere, they might want to read more about social sciences instead.
- throwaway2562 3y agoPersonally, I’m very grateful to Simon Willison for all his posts in 2023, so this is a small note of appreciation. His experiments are always interesting and clearly written, mercifully low-jargon, hype-free and practically-oriented. Happy New Year to simonw!
- skepticATX 3y ago> Except... you can run generated code to see if it’s correct. I have seen this idea in many different places. I really think we should stop saying it. Running code obviously does not confirm that it is correct. Even running a comprehensive set of tests isn’t enough if you haven’t developed a mental model of your system. The lack of mental model development is what concerns me most about LLM-driven development. Copilot has the right idea, because it generates less code and so the user theoretically has more of an opportunity to grok its output.
- IanCal 3y ago> I have seen this idea in many different places. I really think we should stop saying it. Stripped of context, sure. But in context in the article it makes perfect sense, it's about how hallucination isn't as much of a problem for coding as you might expect
- tasuki 3y agoWith property based testing, writing code could be left entirely to the LLM.
- jiggawatts 3y agoI suspect that this problem can be solved with greater computer power — instead of trying to squeeze everything into the context, LLMs will be fine-tuned to the design and architecture of each codebase. Essentially, we’re relying only on “short term” memory for code generation at the moment, but should be using a mix of long- and short- term memory, just like human programmers. Copilot and similar use-cases is like asking a random stranger a question on Stack Overflow. They may or may not be able to provide a useful answer, and that is highly dependent on the amount and quality of the context provided. If you want an “AI coworker”, then proper “learning” will be needed…
- simonw 3y agoSure, if you blindly accept code just because the LLM has executed it (and maybe written tests for it too) without actually understanding what it does you'll run into trouble. But if you use it responsibly, LLMs can help you get to that accurate mental model. Code explanation is on of the things that they are really good at. My personal rule is that I won't commit code generated by an LLM unless I'm confident I can explain how that code works to someone else.
- davidgerard 3y ago> Still, I’m surprised that no-one has beaten the now almost year old GPT-4 by now. OpenAI clearly have some substantial tricks that they haven’t shared yet. GPT-4 is eight instances of GPT-3 in a trenchcoat, so no, it's not clear from GPT-4's age that OpenAI do "clearly" have tricks they've just not released. All technology curves are S-curves.
- simonw 3y agoIf it's that simple, how come no-one has produced a better model yet? There's a huge amount of money floating around this space right now, and anyone who demonstrably beats GPT-4 will instantly be valued at billions of dollars.
- foxhop 3y agogreat article I read a few posts but you say you coined the term "prompt injection" but I'm fairly certain that was a thing discovered by anyone who thinks about using LLMs in production. sql injection/prompt injection
- simonw 3y agoHere's where I coined it: https://simonwillison.net/2022/Sep/12/prompt-injection/ https://simonwillison.net/2022/Sep/12/prompt-injection/ I'm always clear to say that I didn't discover it. I just stamped a name on it to make it easier to have conversations about.
- johnnyworker 3y agoWe learned a bit about LLM, a lot about humans and their desire to move their already outsourced thinking from mediocre humans to mediocre software -- and exactly nothing about AI, because AI doesn't exist.
- 4death4 3y agoThe main thing I've figured out is that people have never heard of the Chinese room argument.