9 ms·
Epistemic legibility: being easy to argue with is a virtue
- deleted 5y ago[deleted]
- bertil 5y agoI believe that this is a key aspect of data-driven leadership, and the Friday meeting that Google founders started and many other companies imitated: make it easier for employees to argue against decisions. No organisation is perfect, or even good, so any effort to make complaints louder, clearer, more structured is incredibly valuable. One grostesque example of where that chain of information is broken is how Customer service teams are isolated.
- egberts1 5y ago“That’s gibberish” probably could be better said as “that goes against all factual truths that I’ve learned.”
- deleted 5y ago[deleted]
- AnimalMuppet 5y agoNo, "that's gibberish" means "I can't tell whether it goes against factual truths, because I can't tell what it's actually claiming." [Edit: And one of the marks of at least some kinds of BS is that it tries to obscure what is actually being claimed, so that you can't disprove it.]
- beebmam 5y agoSuperbly written and argued. Assessing an argument's Epistemic Legibility is a new tool in my toolbox for identifying weak arguments. > I expect having a handle with which to say “no I don’t have a concise argument about why this work is wrong, and that’s a fact about the work” to be very useful. This was my favorite quote from the article
- awb 5y agoI’ve seen “Source?” used as a concise critique against what I consider to be epistemically illegible arguments.
- renewiltord 5y agoYeah, but P(Valid Critique | Source) is low. For instance, behold as I use it illegitimately against you: "Would you mind linking to where you've seen this use of 'Source?'?" Besides, legibility is about the argument - it doesn't make sense to talk about a "Source". The source is me. I am the one making the argument. Statements of fact aren't arguments. "There is a giant octopus besieging NYC right now". There's no argument there. It is merely a statement. An example legible argument is: - There is likely a lot of squid ink covering NYC - This is likely because there is a positively colossal squid creature floating above NYC at the moment - Squid creatures (colossal or otherwise) discharge ink when attacked - We are attacking this humongous monstrosity In fact, "Source?" works better against a legible argument since you can identify which part needs the extra stuff. This argument is fairly legible and is practically just syllogisms. It's merely the case that a premise is wrong - something which you can conclude by asking for the source for a crucial premise. With an illegible argument, you could debunk the source of one of the claims and still be unable to trace its impact on the conclusion. For instance: It's probably raining in NYC right now because it's kind of the conditions that would cause rain if you know what I mean. But there's also this squid creature in the air. It rains when there's squids. Here, read this article about colossal squid ink rain. We all know that squid rain is a thing.
- padobson 5y agoI thought the concept of Epistemic Spot Checks was a great idea, so I was hoping that there might be some on the blog checking materials I had previously read so I could compare my intuitions with the author's hobby, but I didn't find anything. The About Me says the author gave up the project after a year or so, but I'm still curious about updating my own epistemological toolbox. Does anyone have any suggestions?
- skybrian 5y agoMaybe check out other posts on the blog to see how they did it? They've done epistemic spot checks on book chapters. It sounds like a lot of work! Looks like these blog posts are tagged: https://acesounderglass.com/tag/epistemicspotcheck/ https://acesounderglass.com/tag/epistemicspotcheck/
- jl6 5y agoAn excellent piece of terminology. Closely related to the concept of "not even wrong", I think?
- spacemanmatt 5y agoThat description ("not ever wrong") is some of my favorite academic side-eye.
- a1445c8b 5y agoI had to google that phrase and found that it’s slang for unfalsifiable. Based on that, I would agree with you. In addition, it sounds like Epistemic Legibility differs [from Falsifiability] by not necessarily requiring an empirical test to refute one or more claims.
- version_five 5y agoI didn't see it mentioned, I think I "epistemic literacy" is the other side of the coin. I see examples of people demanding citations for reasoning that is part of a work, of people just not understanding something, or of only really being able to blindly follow based on province or authority without trying to reconcile back to what they know. If there is going to be a standard for legibility, there should be one for literacy too - it's especially important when learning from a debate where readers and writers (or sources and sinks) switch roles, to understand how different positions are engaging with each other's arguments, not just how they are making them
- TameAntelope 5y agoThis is actually a huge pet peeve of mine; when people ask for a citation for reasoning, and then smugly declaring victory when no such citation is provided, as if you even could "cite" analysis.
- spacemanmatt 5y agoIt's a bit more than a pet peeve for me. It's exactly shirking any ability to perform or judge analysis, instead granting total deference to "authorities" that should be cited to provide credibility.
- dataduck 5y agoThat's especially fair, as there's a good-faith way of engaging with such things that they've avoided: "Could you expand on this please?"
- skybrian 5y agoEven expert analysis isn't evidence. At its best, an expert can give you a sense of the range of possibilities, which might include things you never thought of. But actually knowing what's happening in a specific case requires evidence. It seems like being clear about what you're doing (are you just discussing possibilities or trying to claim something specific) would go a long way in avoiding such misunderstandings. (And I of course don't know which cases you're talking about, so I'm just talking about possibilities.)
- ganzuul 5y ago...Falsifiable? The author uses a lot of words and seems to appreciate brevity, but isn't the entire article summarized by this one word?
- khafra 5y agoFalsifiability is about grounding out in an experiment that can be performed. Epistemic legibility is a generalization of the concept, where the arguer highlights the cruxes of potential disagreement, and points to whatever evidence they feel is convincing--whether that's experiments you can replicate, official records, expert opinions, or their own introspection.
- ganzuul 5y agoAh, refutable.
- DiggyJohnson 5y agoThis sort of arrogant, unapproachable response is exactly what the article is addressing. You are giving no space, no consideration at all, of someone disagreeing with you.
- ganzuul 5y agoWhat exactly do you think you are doing right now then?
- khafra 5y ago"Refutability" is a more general concept than epistemic legibility, in my opinion. One can (at least attempt) to refute abject nonsense that doesn't actually mean anything by saying "that's abject nonsense, that doesn't actually mean anything." Other arguments might depend on facts about the world, but attempt to hide those dependencies. A Gish Gallop is one such form of argument. These can be refuted, but the interlocutor has to do a lot of work to highlight the factual errors, and the reasons that the argument depends on them. An epistemically legible argument does that part of the work for the other party, so the only thing they must do is show which premises are wrong, or which logical dependencies are invalid. The pre-existing term I've heard that comes closest is the term with the opposite meaning, "Logical Rudeness." https://dash.harvard.edu/bitstream/handle/1/4317660/suber_rudeness.html?sequence=1&isAllowed=y https://dash.harvard.edu/bitstream/handle/1/4317660/suber_ru...
- dilippkumar 5y agoIs this author well known in some community? Their writing is superb, and I have to ask who this is.
- red_admiral 5y agoThis author is certainly known in the rationalist-ish ("less wrong", Scott Alexander etc.) community; whether or not they'd consider themselves a member I don't know. Not all rationalist posts are that well written, but there are certainly more I've enjoyed like that. I think the author might have heard of Seeing Like a State and the idea of legibility through the book review on slatestarcodex, for example. EDIT: from their about page, "Before this, I was a software engineer first at a few FAANG companies and later at start ups." I guess that counts as another community of sorts?
- yboris 5y agoAny time I heard "epistemic" I am reminded of the stellar paper "In Praise of Epistemic Irresponsibility: How Lazy and Ignorant Can You Be?" by Michael Bishop Arguing that in numerous settings, even crude simple linear mathematical models outperform experts in a variety of tasks. https://www.jstor.org/stable/20118248 https://www.jstor.org/stable/20118248
- Rzor 5y agoCouldn't find anywhere else, but here's a link: https://philpapers.org/rec/BISIPO https://philpapers.org/rec/BISIPO. Posted earlier by you.
- bruhvinston 5y ago
- yboris 5y agoAlso reminds me of "computational kindness" where, for example, you give people 2 specific date-times to have lunch, rather than asking them to look through their entire calendar and come up with something (it's easier to check two time slots than to think about all your obligations). Comes from Brian Christian and Tom Griffiths' "Algorithms to Live By: The Computer Science of Human Decisions" https://boingboing.net/2016/06/17/algorithms-to-live-by-what-co.html https://boingboing.net/2016/06/17/algorithms-to-live-by-what...
- chrisweekly 5y agoATLB is such a great book. I need to reread it now that I've learned how to take better notes.
- fsociety 5y agoWhat’d you learn for taking better notes? Always curious how to improve note-taking.
- leobg 5y agoExactly. Have been hoping to find more books by the same author, but apparently it’s the only one he has written?
- ZeroGravitas 5y agoOne of the authors has another couple of books that sound similarly interesting. https://en.wikipedia.org/wiki/Brian_Christian https://en.wikipedia.org/wiki/Brian_Christian
- leobg 5y agoGood point. Thank you.
- morelisp 5y agoNo.
- miga 5y agoHow different is "comprehensibility" from "epistemic legibility"? Comprehensible arguments are easier to argue with, and favoured by rhetorics.
- droopyEyelids 5y agoA comprehensible argument isnt necessarily easy to test. One of the first points he makes in the piece!
- MaxMoney 5y ago
- blix 5y agoI find some of this author's arguments... epistemically illegible. For instance, she criticizes James Scott's "Against the Grain" for using a different definition of 'state' than the first one she found on wikipedia, but it is unclear why this is a bad thing. In fact, Scott himself notes that there are many competing definitions of state that are all imperfect in his context; and that ultimately the choice of one or another is rather arbitrary. It is so that he can develop this context that Scott delays his formal definition. In searching for a legible, bold-face, definition of 'state' on page 1, the author has ignored the context surrounding the concept of state as well as its place in the arguments of the book as a whole. The author suggests she borrowed Scott's sense of legibilty in her own term to suggest that legibilty has some benefits; that she can easily determine the effects of the failure of a single leg of an argument on the whole and she can easily 'spot check' to determine is some fact is true or false. But in her application of this concept, especially the section on "Against the Grain," she demonstrates primarily that her approach is causing her to miss nuance, trip over ambiguity, and ignore context. Ironically, this is the exact critique Scott presents of legibility in his other work.
- computerphage 5y ago(the author is a woman: https://acesounderglass.com/about-me-2/ https://acesounderglass.com/about-me-2/ )
- blix 5y agoOops. Thank you. I need to be more careful.
- ggm 5y agoBeing easy to argue with is quite distinct from being easily brought to argue, or being argumentative about easy things. Kindness in argumentation means caring more about the right solution than winning. Unfortunately I have to deal with a lot of people who really only want to win, or who will change their basis of argument in order to win, even if it means espousing the view they initially opposed, as if it was their core line of reasoning! I also deal with people who are only there for the argument. Being devils advocate is a sport for some.
- jancsika 5y ago> Unfortunately I have to deal with a lot of people who really only want to win, or who will change their basis of argument in order to win, even if it means espousing the view they initially opposed, as if it was their core line of reasoning! This is orthogonal to the author's point. E.g., people who only want to win can make use of epistemic legibility to make their wins clear to themselves and/or others. People who change their core line of reasoning can opportunistically switch between two epistemic legible points. If in either case the speaker doesn't use what the author calls epistemic legibility, then it is difficult to tell what the speaker means.
- ggm 5y agoYes, in strict sense this is all orthogonal. It's riffing down a rathole. What I call "Legalistic" argument is the form which allows two oppositional basis of reasoning to be used simultaneously because any reason to invalidate the case at hand is acceptable, even if contradictory. Working with ex lawyers, debate team members and legal degree graduates I get this a lot. Also programmers. Well, not the ones who do numerical algorithms, they're used to floating point rounding error. I think the fundamental problem can also be cast as the problem of language. A word like "few" is a classic example of an undefined value which is interpreted differently by people. To me, a few has to be below 2% to be disregardable. To others, closer to 10%. In numbers less than ten, a few can mean almost half to some people because three, is a "few" of ten and they forget how close 3 is to 4. This also hinges on "almost" and "nearly" An epistemic line of reasoning would presumably state its basis to approximation?
- slibhb 5y ago> Finally I worked my way up to “first walled, territorial state”. Not thinking super hard, I googled “first walled city”, and got a date 3000 years before the one Scott cites. Not a big deal, he specified state, not walls. What I can google to find that out? “Earliest state”, obviously, and the first google hit does match Scott’s timing, but… what made something a state, and how can we assess those traits from archeological records? I checked, and nowhere in the preface, introduction, or first three chapters was “state” defined. No work can define every term it uses, but this is a pretty important one for a book whose full title is Against the Grain: A Deep History of the Earliest States. Isn't this kind of spiral going to appear when you analyze almost any claim? It's where skepticism comes from. When you get down to it it's very hard to say a claim is truly "epistemically legible" outside math and the hard sciences (and even there there are dissenters). And if someone does manage to write a history that's relatively epistemically legible it's going to be boring as hell. All histories contain narratives and all historical narratives are seriously flawed. What saves history (besides the entertainment value) is that some narratives are better than others. We can move closer to the truth through discovery and analysis of information. At the end, though, we're still left with seriously flawed narratives, just less flawed than the previous ones if history as a discipline is functioning.
- robbedpeter 5y agoConsider the difference between modern Egyptology wrt the history of the pyramids and the "history" of scientology, Xenu, and alien spirit volcanoes. The first is far more epistemically legible, the second is pure ideological fantasy (or sci-fi, considering the author. ) There's a much smaller gulf between Principia Mathematica and the history of Egypt - differences in recorded historical facts allow for differing interpretation but the possibilities are constrained and have a huge amount of overlap with hard science - we can be almost as sure that Tutankhamen was a real king as that Abraham Lincoln was president of the US, and the certainty of both having been real probably exceeds five 9's. The probability of Scientology being real, as she is wrote, is probably below 0.1e-100. From a Bayesian perspective, you can be 100% certain of things like your own subjective experience, and from there you can presume certainty for things whose probability or improbability exceed some threshold - you might never know if Tutankhamen was a nice guy or generally a prick, but his existence is founded within enough other certainties that you can (probably) assign that fact the moniker of "100% real" with great success. The same with "Xenu is cult nonsense."
- jka 5y agoTo draw a comparison with software development: how much test coverage does this argument have? And do those tests genuinely handle most expected inputs/outputs and demonstrate correctness? Similarly, recursively: do the claims that the argument relies upon also have good test coverage? And, extrapolating beyond the article: how can we identify the flaws with minimal effort and help the authors to correct those (or fork improved arguments and build support for those when they refuse to)?
- ZeroGravitas 5y agoI think this is a valuable perspective, but also is a bit narrowly focused. It's not the single argument/book/article or whatever, you need an ecosystem of tools, institutions, datasources that work towards truth. I think this is probably what they are building towards, but felt it wasn't given enough emphasis. One of the examples is acoup, citing ancient historians, yet one of regular points is that those ancient historians, weren't really historians as such and are often making an argument and making stuff up to fit whatever they were trying to argue for at the time. So it's naturally quickly recursive, if you are citing people who are hard to argue with.
- sitta 5y agoI did an "epistemic spot check" of the section on Against the Grain, which caught my eye because I just finished reading the chapter on state formation in The Dawn of Everything. Result: It was indeed legible but was oddly false. I could not find the "well accepted definition" of the state they sourced from Wikipedia [1]. They give the impression that there is an overwhelming consensus as to what the definition is, whereas the Wikipedia page actually states throughout "there is no undisputed definition of a state", "there is no academic consensus on the definition of the state", and provides multiple different definitions. I have not read Against the Grain, but it seems entirely reasonable for the author to offer their own definition, though it sounds like they could have been more forth coming with it. [1] https://en.m.wikipedia.org/wiki/State_(polity) https://en.m.wikipedia.org/wiki/State_(polity)