9 ms·
Ontology Is Overrated: Categories, Links, and Tags (2005)
- mayneack 8y agoAll I see is a giant ad for ED pills. This is what I see: https://archive.fo/rZchC https://archive.fo/rZchC over time: https://archive.fo/http://www.shirky.com/writings/ontology_overrated.html https://archive.fo/http://www.shirky.com/writings/ontology_o...
- oftenwrong 8y agoThere may be malicious software on your computer.
- jszymborski 8y agothis redirected on both GP and archive.fo's servers... I can't replicate, but I think we can rule out malicious software on GP's computer.
- oftenwrong 8y agoThat makes sense.
- wslh 8y agoI see the same and not malicious software in Android.
- nafey 8y agoMe too. Sibling comment says it might be due to malware. Should I be concerned?
- ChuckMcM 8y agoThat is rather odd, on Chrome/Win10 I see the original article, and looking at the page source it seems rather innocuous (no scripts or ad banners etc). What browser and OS are you using?
- ghostly_s 8y agoSame here. Definitely not malware, on an enterprise-managed system. :) DNS hijack perhaps?
- mattigames 8y agoLack of HTTPS most likely, meaning an infected ISP or alike doing a MITM attack. Interestingly the wayback-machine snapshot is not affected: https://web.archive.org/web/20190123000016/http://www.shirky.com/writings/ontology_overrated.html https://web.archive.org/web/20190123000016/http://www.shirky... After digging a little it seems like the redirection is happening server side (302, 0 bytes e.g. not JS) and its controlled from a malicious site called google-static(.)com, if anybody wanna investigate this further it's this one: http://google-static.com/search/?niche=unknown&page=http%3A%2F%2Fshirky.com%2Fwritings%2Fontology_overrated.html&h=shirky.com&p=%2Fwritings%2Fontology_overrated.html&ref=https%3A%2F%2Fwww.google.co.uk%2F
- sevensor 8y agoI don't think it's malware, at least not on the client. I see the same thing, and I'm using w3m on Linux.
- spydum 8y agoReally common malvertising attack, server is probably compromised: https://www.welivesecurity.com/2013/05/07/linuxcdorked-malware-lighttpd-and-nginx-web-servers-also-affected/ https://www.welivesecurity.com/2013/05/07/linuxcdorked-malwa...
- crucialfelix 8y agoI saw that earlier this morning as well. It's fixed now.
- ChuckMcM 8y agoI enjoyed this piece, mostly because I disagree so strongly with it :-). Clay takes the topic of Ontology, contextualizes it into an impractical domain, and then calls it overrated. Cars are overrated too because they can't cross oceans right? When done correctly, ontology combined with knowledge graphs can make an impractical problem much more practical. Consider for the moment the problem of 'fake news'. What characterizes 'fake news' is that it has facts or concepts that are not in alignment with "true" facts (authoritative). And without getting into the debate of what is and isn't true, you can take a document, a knowledge base populated with trusted facts, and a topic ontology and score that document for alignment with the existing data set. Whether you use that for checking Wikipedia articles or flagging fake news its a very powerful combination.
- AnimalMuppet 8y agoI'm not sure about that. In Shannon's Information Theory, stuff that aligns with the existing knowledge base contains 0 bits of information. Things that contain new information cannot line up with the existing knowledge base; "news" is exactly the word for such things. You might be able to say that fake news doesn't align with true facts that aren't part of the facts being reported as news. That is you can tell that "the color of the sky unexpectedly changed from green to yellow yesterday" is fake news, but you can't use true facts to tell that ""the color of the sky unexpectedly changed from blue to yellow yesterday" is fake news. (I mean, yes, you might still use true facts about atmospheric composition, light scattering, and the spectrum of solar output, but you can't use "the sky is blue".)
- ChuckMcM 8y agoI think that is exactly right. So lets say you consider a news story as a 'stream' of bits. And you can demodulate those bits using some formula and there are enough extra bits in the message that you can correct for errors in the channel. If you get 5 streams of bits and four of them correlate with some epsilon number of new bits, and the fifth has 10x epsilon new bits, one of things is likely true. Either the odd stream out is corrupted or the stream has changed. Apply that to news stories where the ontology (O) and knowledge graph (KG) are combined to "error correct" the content of the story. "Error bits" would be defined as relationships that don't match what the ontology says can be true, or facts that are different than those facts already in the knowledge base. You can flag the odd news story as lacking alignment with the existing KG&O, further you can quantify that lack of alignment fairly precisely. So if the news story has 0 bits of information it correlates very strongly with other existing stories. If it has many bits of information it contrasts with other existing stories. At some number of stories on the same topic you can begin to reason about which are more likely 'true' and which are more likely 'false.'
- sharpercoder 8y agoThe same is so true for programming, in particular OOP. In my experience, code is much easier to change when a loosely coupled set of interfaces is built as opposed to an hierarchy of classes.
- tabtab 8y agoIndeed. This is also why I think OOP is missing something to scale better in terms of flexibility and domain size. The ideal code structure for a particular need is rather arbitrary. OOP "prefers" things in a hierarchy, both in terms of inheritance, and in terms of an object being less powerful than a class (in most languages). You can force or use OOP outside of these, but it's unnatural in my opinion. For example, why is it not easy to add an "onClick" event handler method to a particular button in a Java GUI? One has to use lambdas instead. Attempts to reorg the GUI engine to remedy such create side-effects. Java's OOP model is simply not powerful enough to do GUI's naturally. Conway's Law seems to apply to domain structures as well. Fit matters. Something like Lisp allows one to create behavior-containing "structures" that are customized to a domain or need, but can get too confusing. Lisp can easily get too hard to read and follow for most mortals, and is why it never became mainstream despite being around for 60-ish years. We need something in between traditional OOP and "full meta".
- avinium 8y agoI think most ML-derived languages strike the right balance - functional languages that incorporate enough OOP principles to get things done in the real world. I increasingly advocate F#, and many people recommend Elixir for these purposes too (though I'm not familiar with it myself).
- tabtab 8y agoI've yet to see useful things F# can do in my domain that couldn't be easily done other ways. Most of the examples are in esoteric domains or "lab toys". I'm not saying it's not useful, it's just that it hasn't been presented in a way clearly useable to my domain, which is "typical" business applications. For example, much of the issues related multi-tasking and parallelism are typically farmed off to the RDBMS and A.C.I.D. transaction handling. It may be a boring domain to many, but it's important for commerce.
- wheels 8y agoThis article is 14 years old, and dates back to a time when the debates about the "semantic web" had a lot more wind in their sails. (I made similar arguments around that time...)
- dekken_ 8y agoI had a whole semester on the semantic web in 2008. Having grown up with the internet as it was, I thought it was useless nonsense
- citilife 8y ago[2005] should be added to the title > This piece is based on two talks I gave in the spring of 2005 -- one at the O'Reilly ETech conference in March, entitled "Ontology Is Overrated", and one at the IMCExpo in April entitled "Folksonomies & Tags: The rise of user-developed classification." The written version is a heavily edited concatenation of those two talks.
- seriocomic 8y agoGoogle has this dated as [2014] - June 14 to be exact. Google also shows the exploit-affected site title as mentioned in other comments... https://www.google.com/search?source=lnt&tbs=cdr:1,cd_min:1/1/2005,cd_max:&tbm=&q=inurl:http://www.shirky.com/writings/ontology_overrated.html https://www.google.com/search?source=lnt&tbs=cdr:1,cd_min:1/...
- PaulHoule 8y agoThis article has made the rounds so many times that surely Ontology must be underrated for now.
- jrochkind1 8y ago2005. did what he predicted happen? I think not?
- dannyobrien 8y agoMight be good to add a date to the title.
- hnzix 8y agoOntology's key strength is that it allows for discovery. Yes it's a form of curation, with all the bias that implies. Sometimes I want a domain expert to curate hierarchical lists for me to explore. Both Ontology and Tagging have their place. The net is vast and infinite, sometimes it's nice to have a map.
- dfischer 8y agoI think this highlights exactly the dangers of social media and communities centered around fixated niches. I've been thinking lately of how to remedy that and this post came up at just the right time to get the mind juices flowing. At a high level I see a decentralized community that doesn't rely on forums/tribes/subreddits and incentivizes tagging like old school del.iciou.us. This enables higher chance of cross pollination and less group think. I could really see it working well with some flavor of ethereum/ipfs/incentives. Something something, everything is in cycles? Hah.
- refusing 8y agoEh, people will resist levers of control. Even levers with good intentions. People seek a payoff. Even if you have some interconnect, that forces patterns of use, why are they crawling through your pipes?
- burtonator 8y agoI've been working on a tag-centric document manager for the last 90 days: https://getpolarized.io/ https://getpolarized.io/ It allows you to tag and manage everything you're reading and the primary management metaphor is the 'tag'. It's a central repository for all your reading. PDFs, web content, and it supports annotation (highlights, comments, etc). There are a bunch of clear wins here. Related tags are awesome. You can build a bunch of really nice derived metadata just by managing your tags on the documents. For example, I've been reading a lot about growth hacking as I'm trying to get Polar to 100k users. (We're officially 10% of the way there today!) Since I have a bunch of documents named 'growth' Polar recommends startups, venturecapital, and marketing as secondary tags. Also, since Anki supports tags (and Polar supports Anki sync) these systems are compatible. Polar tags are also Twitter tags. While we haven't enabled this feature yet your annotations could be exported to Twitter and the systems are compatible. We're still getting users that want hierarchy though. I'm not sure what I want to do here. I'm considering building out algorithmic hierarchy. For example, if you have two documents with the first tagged 'tech, microsoft' and the second tagged 'tech, linux' we can infer that tech is the parent of 'microsoft' and 'linux' ... and it would still support tags. the problem I have now is that folder hierarchy is still being requested by our users but I'm resistant to implement it yet.
- desc 8y agoTags do not fit spatial memory. Tags are utterly worthless in any spatial context. You're at the mercy of a search engine's implementation and index foibles for finding things through search queries. A hierarchy maps onto our spatial memory, which we use to figure out where we've been and go back to it. There's a lot to be said for maintaining spatial metaphors in information space. Another little detail here is that spatial organisation (in meatspace) is a shared environment. A single 'shared' ontology is useful even if it's nonsense, because it's still a shared frame of reference in which navigational directions can be shared.
- burtonator 8y agoDid you read the last part of my comment? I clarified that there's a workaround to give hierarchy.
- sonnyblarney 8y agoThis is a great post. The problem with the thesis is that just because classical ontology doesn't work for the entire internet, doesn't mean that we can't apply it in many domains. Formal ontology could be used very well in a variety of areas. Informal, or less concise ontology again in many areas. And leave tagging for the rest.
- maxerickson 8y agoAren't tagging and "informal ontology" pretty much equivalent?
- sonnyblarney 8y agoWell there are surely other informal ways of doing 'ontology'. The point being - more rigorous methods can definitely be valuable in areas, and I don't think it's a good idea to ignore this fact. It's a bygone issue because there wasn't a critical mass in place to make it work, but there could be.
- platz 8y agoQueue up the quotes from "Zen and the Art of Motorcycle Maintenance"
- thedailymail 8y agoI enjoyed reading this article, but was perplexed at the statement "Cities are real. They are real, physical facts. Countries are social fictions." City names and boundaries are just as, if nor more, socially constructed as those of countries.
- skybrian 8y agoThis is true of names and borders, but the cities themselves remain where they are even when names and borders change, so they're more persistent than countries.
- cheschire 8y agoThat might seem logical on the surface, but dig just a little deeper and the flaws become readily apparent. For example if you're looking for the population of New York between 1850 and 1950, you would see a potentially dramatic shift of the population around the turn of the century, which would be misleading if you didn't already know the caveat about the consolidation of the city in 1898. However that shouldn't discourage the tagging of data by city. It just means that a city, as metadata, is no more or less functional than country, as the grandparent comment suggests.
- skybrian 8y agoWell, yes, few things are entirely immutable. Cities do grow and (rarely) shrink or disappear. But this is rare enough that it's useful to hang other data off of their names. For example, take the locations used in time zone databases, where an official way to name a location is something like America/Los_Angeles. The assumption is that major cities don't get split across time zones and users know which cities they are nearby that they share a time zone with. Country names aren't used. A lat/long pair would be more precise, but sometimes precision isn't needed.
- munificent 8y agoThis is one of my favorite articles, which I first read when it was new and still informs how I think about organizing information and the web.
- gases 8y agoUgh. This is a priceless example of the kind of quackery that puts us in turing tarpits by trying to extricate us from turing tarpits. If you ever hear phrases like “pure functional” or “object oriented” or “semantic web” or “restful uris” or “inversion of control” or “impedance mismatch” just run away. The person you are talking to does not have the answer. Is trying to sound like they do. Is pouring glasses of kool aid. Case in point: Noble Gases. Okay? Listen. They’re gases. Unrefridgerated? Contained in pressure vessels? In a laboratory setting? They are gases. This is where you see the rubber leave the road. He has never worked with gases. Doesn’t think about them as gases. Wants to lead you down a rabbit hole of plasma bound by cosmological gravitation, cryogenic dewar flasks, rocket ships, tokamaks, and anything else to light your imagination on fire and lead you over the precipice and into a holy war that need not be fought. The periodic table is indeed periodic. It’s stable now, but it does change. We knew noble gases were special, before we knew about valence electrons, orbitals, the UV catastrophy and so on. So when he says that helium should not be classified as a gas, he’s wrong, because that fact is a useful means of reflecting upon the manner of discovery for that class of elements, which indeed was one of THE KEYS, that unlocks the very idea of chemical bonds, be they covalent, ionic, hydrogen or otherwise. Do call noble gases, gases.
- deleted 8y ago[deleted]
- empath75 8y agoReddit is basically a flat ontology for images, if you think about how most people use it.
- sbr464 8y agoInteresting, the url picks up as: "Female Viagra UK, Buy Viagra - Online Pharmacy, Best Offer" When pasting in a notes app. Couldn't tell if it was an inside joke with regards to the subject matter.
- edoo 8y agoHaha, if you don't enjoy this you will enjoy it anyway.
- hydrox24 8y ago> You need a hierarchy to manage a file system. I find this a strange assertion after several paragraphs which vociferously assert hierarchies are redundant in the virtual space. In fact, OS/400 is a 'single-level' store using objects, so it has even been shown in practice that you do not need filesystems to build a useful OS, if I am not mistaken. Am I mistaken?
- 1wd 8y agoI also found this assertion surprising. I often wish filesystems had good native support for tagging and not just a strict hierarchy. Even hardlinks / symlinks seem like a poorly supported afterthought, especially on Windows, and generally not worth the effort to use them for user-level data organisation. But I'm not sure how a purely tag based would work in practice, so thanks for the pointer to OS/400. Another example is the Windows Start Menu. The hierarchy is basically useless and a huge pain to use. I have give up on maintaining a sensible hierarchy long ago. Windows 10's search is much better, except when it fails you're forced to go back to the hierarchy. One thing missing here is that you can't navigate from a search result to the hierarchy.
- aaron695 8y agoThis has been known to be totally incorrect for 10+ years now. Is this about bad predictions? Tags failed. No one uses them. (#hashtags are not tags, they are more channels) Can you think of one site that uses them and it's useful? Ever looked a library book up and the tag is why you got a good result? The study I saw showed all the actual value on Flickr came from the title of a photo, not the tags.
- james_s_tayler 8y ago"when people were offered search and categorization side by side fewer and fewer people used categorization to find things" Two thoughts pop into my mind which guide me gently to the conclusion we need to be careful here. 1) every configuration is a set of trade-offs 2) any parameter or paradigm pushed to extreme produces perversion On point number 1: categorization contains the benefit of discoveribility when you lack the information necessary to form the search query in the first place. On point number 2: search forces you to generate the query and direct your attention towards a given subject. However, some of the most important discoveries you have ever made in your life were when other people held your attention in conversation and kindly directed it in a direction it wasn't going but that arrived at an illuminating destination. We need all implementations to some degree to get all possible benefits. I suspect this is why suggestion algorithms have flourished but in doing so they create echo chambers because they are a charicature of yourself bending your own ear. If only algorithms could suggest what you needed to hear and not what you wanted to hear. Some books I have bought at my local bookstore I never would have found on Amazon. It's amazing what being able to direct our own attention and have the world organized in exactly that way has done for us, and it is equally as amazing as the paths we are lead down when we let other people direct our attention.
- cheschire 8y agoAs a solution developer, I find the most bang for my buck is when I produce solutions for people who come to me with a problem rather than a solution. Imagine if Google made you answer the question "Why?" five times before it showed you results. I wonder if a well trained network would produce such accurate results we would no longer need to see a list of results, and could simply hit the lucky button. But good luck finding a user who's willing to answer "Why?" five times rather than brute-forcing a search engine into their "echo chamber," as you accurately described it.
- james_s_tayler 8y agoWell theres no disagreement from me that what you describe is how it plays out. My caution is that we have found the equivalent of cheap, fast, microwavable meals and we are now consuming them almost exclusively and in 15 ~ 20 years it's going to become painfully obvious what deleterious side-effects arise as a result of that. We can't see it now, so we don't feel the need not to do it, and that simply is what it is, but in time it will act as a control signal that nudges us to modify our behavior. This is both a great and terrifying time to be alive. The 20th century was full of some pretty hefty social experiments and the thing with those were they were obvious and in your face. The 21st century versions are much less obvious and reveal themselves very slowly.
- Angostura 8y agoAnyone know what Clay is up to at the moment? Seems to have gone very quiet in the last 5 years.
- johnchristopher 8y agoThe site is now displaying spam :(