8 ms·

Dublin Core's dirty little secret (2010)

98 points by dcminter 5y ago

xwkd 5y ago
I worked for OCLC for about five years, so I have a lot of sympathy for the pains that archivists go through when trying to standardize content metadata. Can't be that hard of a problem to solve, right? I mean, we're only talking about coming up with a good solution for cataloging the sum total of all human knowledge. (Not a small undertaking.) Libraries are caught between a rock and hard place. On the one hand, they have to be stewards of this gigantic and ever growing mound of paper, and on the other hand, they have to deal with the lofty ideas of the W3C and Tim Berners-Lee, trying to connect all of that paper to his early 2000s vision of the ultimate knowledge graph / the semantic web. No wonder we're sticking to MARC 21. The only people using that web for research are universities. The rest of us are using WHATWG's spawn-of-satan hacked together platforms because the technology always moves faster than catalogued content. Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams.
- sswaner 5y ago
  “old programmers' utopian fever dreams” - accurate description of me when I first found Dublin Core. Never made it to production. It was unnecessary overhead for describing internal content.
- ghukill 5y ago
  >> "Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams." Greatest thing I've read on HN. As a librarian and developer, can confirm. At least in most cases...(slipping back into fever dream)....
- smitty1e 5y ago
  Sayre's Law: "In any dispute the intensity of feeling is inversely proportional to the value of the issues at stake." https://en.m.wikipedia.org/wiki/Sayre%27s_law https://en.m.wikipedia.org/wiki/Sayre%27s_law Was there ever a less essential fiefdom than citation formats?
  - dsr_ 5y ago
    Have you noticed that search engines suck? Citation formats are an attempt to end up with a search engine that doesn't suck. (They can do lots of other things along the way.) Options: 1. Accept any format and try to turn it into your own internal representation. Problems: (a) your own representation is a citation format; (b) you need to write an infinite number of converters and hire an infinite number of trained people to work out the edge cases. 2. Accept a limited number of common formats. Problem: your search engine will not be useful for a majority of the corpus. 3. Convince everyone that your new citation format is unstoppable. Problems: (a) convincing everyone; (b) actually having that citation format cover, say, 99% of the cases; (c) XKCD#927 (Standards). Dublin Core is/was a terrible attempt at a type 3 solution.
  - karaterobot 5y ago
    Some people catalog information every day, so it matters to them for practical reasons. Same with people who rely on those resources being accurately cataloged.
    - smitty1e 5y ago
      I'm ok with obsessing about the data. Presentation, an order of magnitude less. Substance >>> style.
      - karaterobot 5y ago
        Cataloging format is to style as database modeling is to... well, style. It's got nothing to do with aesthetics, it's about describing the data in a way that makes it useful later.
      - 5y ago
- lyaa 5y ago
  The problem with models like GPT-3 is that they are unable to differentiate between information sources with different "trustworthiness." They learn conspiracies and wrong claims and repeat them. It's possible to feed GPT-3 prompts that encourage it to respond with conspiracies (i.e. "who really caused 9/11?") but it also randomly responds to normal prompts with conspiracies/misinformation. A recent paper[0] has looked into building a testing dataset for language models ability to distinguish truth from falsehood. [0] https://arxiv.org/abs/2109.07958 https://arxiv.org/abs/2109.07958
  - pjc50 5y ago
    > A recent paper[0] has looked into building a testing dataset for language models ability to distinguish truth from falsehood. Isn't this a massive category error? Truth or falsehood does not reside within any symbol stream but in the interaction of that stream with observable reality. Does nobody in the AI world know Baudrillard?
    - rendall 5y ago
      It should be at least theoretically possible for an AI to identify contradictions, incoherence and inconsistency in a set of assertions. So, not identifying falsehood per se, but assigning a fairly accurate likelihood score based solely on the internal logic of the symbol stream. In other words, a bullshit detector.
      - nimish 5y ago
        > It should be at least theoretically possible for an AI to identify contradictions, incoherence and inconsistency in a set of assertions Not in the slightest. Likelihood of veracity is opinion -- laundering it as fact to make some people feel better doesn't make it any more subjective, or authoritative.
        rendall 5y ago
        I think we're not disagreeing, exactly. As a simple example, here is a set of assertions: * The moon is made of green cheese * The moon is crystalline rock surrounding an iron core It wouldn't take an AI to see that both of these can't be true, even if we weren't clear about what a moon is made of, exactly. Some of our common understanding could contain more complicated internal contradictions that might be harder for a human to tease apart, that an AI might be able to identify.
- xg15 5y ago
  > Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams. I mean, at this point, wouldn't it be a lot simpler to go back to the middle ages (or earlier) and have a few humans memorize all that stuff? It's not as if GPT3 would give you any more insight than that approach...
- wvh 5y ago
  Having worked with DC, Marc21 and some of its precursors, I feel that one major problem with the approach is that cataloguers try to infinitely cut up metadata into ever smaller pieces until you end up with a impossible large collection of fields with an overly high level of specificity and low level of applicability. For example, the middle name of a married name of a person that contributed to one part of one edition of the work in a certain capacity etc. You end up with so much unwieldily specific metadata that consistent cataloguing and detailed searching become nigh impossible. Ever since search engines, the world has moved into using mostly flat search engines rather than a highly specific facet search for deep fields. Of course, one would want something a bit smarter than full text search, but the real, human world is so complex that trying to categorise any data point quickly becomes an exercise in futility.
sgt101 5y ago
Was involved with a project once upon a time that spent six months developing ontologies for event ticketing, not me thank god, but another team of about eight. The delivered ontology got used twice or maybe three times, and it didn't cover all the corner cases we knew about.
- smitty1e 5y ago
  Heard a bloke introduce himself at the onboarding as a "Sematic Ontologist". His sobriety was only exceeded by his earnestness. I prayed he'd not become attached to my project, as he looked like the sort who could love a problem for weeks without ever reaching a conclusion.
  - jdixnneij 5y ago
    Sounds like the eternal student, they just don't work in business, although seemingly I keep getting lumped with the useless persist question askers, sometimes I feel like I discussing shit with David Attenborough, just get on with job ends rant
    - jdixnneij 5y ago
      Truth hurts. Good luck on your third phd
  - Vinnl 5y ago
    Oh wow, having interacted with the SemWeb community quite a lot in the past couple of years, > the sort who could love a problem for weeks without ever reaching a conclusion. is such an accurate description of a number of people part of it. Possibly the root cause of all the problems that led to it never taking off at the scale they'd envisioned.
    - tasogare 5y ago
      The semantic web is a non-solution in eternal search of non-problems.
wheybags 5y ago
Was 90% sure this was going to be an article about homelessness in Dublin city centre (the real Dublin, not some imitator in Ohio :p)
blipmusic 5y ago
There are also modular approaches like CMDI [0] out there, that allows for constructing a metadata profile with a corresponding schema [1]. A single metadata standard won't be able to cover all disciplines regardless. Too many free text fields that can't be properly validated. E.g. if you work with documenting minority languages, language ISO codes are vital (assuming one has been created for the language in question). [0]: https://www.clarin.eu/content/component-metadata [1]: https://www.clarin.eu/content/component-registry-documentation
tuukkah 5y ago
These days, you can use Wikidata and the related tooling such as Scholia. Here's a starting point to their ontology, including the difficult details such as the "page(s)" qualifier for the property "published in": https://www.wikidata.org/wiki/Wikidata:WikiProject_Source_MetaData/Bibliographic_metadata_for_scholarly_articles_in_Wikidata https://www.wikidata.org/wiki/Wikidata:WikiProject_Source_Me... Scholia: https://www.wikidata.org/wiki/Wikidata:Scholia https://www.wikidata.org/wiki/Wikidata:Scholia
thinkingemote 5y ago
I think one of the issues is because librarians work with things that have been made and do not change. The catalogues also traditionally did not change, but there's no reason now why this should be the case. If we look at wikidata or openstreetmap for example the way things are categorised changes and evolve, some things stay the same, new things get added, some things get deprecated, and bots or humans can update existing records and machines can handle any deprecations Far better then to start simple, get adoption and update records as you go, I think.
- dredmorbius 5y ago
  One of the particularly notable things about libraries and catalogues is how much does change. There are on the order of 1--5 million new books published in English each year (about 300k as "traditional" publications, fairly constant level since the 1950s), the largest collections have tens of millions of volumes, the cataloguing technology and standards have changed tremendously over the past 50 years, and the role and usage of libraries themselves is under constant flux. At the same time, budget and staffs are small relative to the total record store. The challenge of organising, classifying, and making accessible all human knowledge has occupied numerous great minds for centuries. We're familiar with Google's take, marrying full-text search with a document-ranking model. That worked relatively well for about 20 years. It's now showing extreme signs of stress. At the same time, much of the past (and present) traditionally-published media is finding its way online, whether the original publishers and established libraries like it or not. LibGen and SciHub may have far more to say about the future of cataloguing standards than the OCLC.
  - cratermoon 5y ago
    Oh and how those categories change and are subject to human error and bias. Library of Congress Class D: WORLD HISTORY AND HISTORY OF EUROPE, ASIA, AFRICA, AUSTRALIA, NEW ZEALAND, ETC. Subclass DB: History of Austria. Liechtenstein. Hungary. Czechoslovakia https://www.loc.gov/aba/cataloging/classification/lcco/lcco_d.pdf https://www.loc.gov/aba/cataloging/classification/lcco/lcco_...
PaulHoule 5y ago
Dublin Core was always trying too hard to not be hard to use. It always struck me as a metadata standard for the library at an elementary school. I was amused at how Adobe’s XMP format amended DC used features of RDF that most people were scared to use (ordered collections) to solve the simple problem of keeping track of the order of author’s names on a paper. The big trouble I see with semweb standards is that they stop long before getting to the goal. RDFS and OWL for instance solve some problems of mashing up data from different vocabs but can’t do the math to convert inches to meters which is absolutely essential. I was not so amused to see Adobe thoroughly nerfed XMP and it no longer sucks in EXIF metadata from images. I was hoping I could find the XMP packet and put it through an RDF/XML parsers and get all the metadata from my images but even in Lightroom images the XMP packet is a nothingburger these days. I guess people complained about the GIF files that had 2k of pixel data an 80k of XMP and that Adobe was co-opting other standards. Heck they even deleted most of the content from the standard including how to express EXIF in RDF so you can’t stick XMP in your database and SPARQL it.
- blipmusic 5y ago
  Depends on what device generates the image perhaps? DJI Drones have a lot of info as EXIF XMP. I just parse that as XML. EDIT: It's not 80k, but good enough as a GPS log.
  - PaulHoule 5y ago
    The gif in the story was generated by adobe tools in the bad old days, circa 2005. I noticed the nerfing happened in the last 5 years when I looked closely at what Lightroom does.
    - blipmusic 5y ago
      In terms of wasted space, only 1/8th is actual xmp for that DJI exif chunk, the rest is padding for (13mb jpg:s in our case). 8k, so 1k actual xmp data of which a lot is structural. I've only tried with scripts, verifying with exiftool and a hex editor every now and then.
jiggawatts 5y ago
Dublin Core reminds me of SAML. Designed as a bag of standards parts, not as a complete standard.
amichal 5y ago
Dublin core has always been rough and strange and I’m SURE actual librarians can tell me all sorts of stories about complex things but schema.org has a fine model at first glance https://schema.org/ScholarlyArticle https://schema.org/ScholarlyArticle. Check out the MLA example at the end and how DOI and articles over multiple issues are handled etc.
mark_l_watson 5y ago
I am not sure if I agree with this article. The semantic web and linked data are built using layers of schemas and Ontology’s and changing old stuff is a bad idea because links get broken. Additive systems, instead of creating new versions, will always seem a bit messy. If you look at valuable public KGs like DBPedia and WikiData you will see these layers of old and older schemas. My argument that this is not such a bad thing does have a powerful refutation: the slow uptake of linked data tech and KGs.
mikewarot 5y ago
Back when I was an IT Guy at a small marketing company, I did whatever was asked of me (I'm getting paid, so why not). I got pretty good at data entry, and it's fairly enjoyable. You're not worried about bigger issues than reading scribbles on paper, and trying to get them entered correctly. It is from this experience, that I think they should have done the following: Sit everyone on the committee down down at terminals, and make them do card catalog data entry for a week, just typing into a unformatted text file. After those dues are paid, then you get to participate for the year. I think contact with the data at hand would have rapidly lead to a far better understanding of the required structures.
- cratermoon 5y ago
  Librarians spend years studying just cataloging to be able to take a publication a library acquires, put a Dewey or LoC number on it, and shelve it, and do it all in a way that makes makes it possible to find it again later when someone wants it. Cataloging is an entire sub-specialty of Library and Information Science. A week of data entry would just scratch the surface.
  - mikewarot 5y ago
    I'm not suggesting it would give an encyclopedic knowledge, but it would at least acquaint them with the actual data and categorization systems in use in a very visceral way. In a related way, I find myself watching many of the old IBM videos about mainframes and the punch card systems that proceeded them to have a better feel for what came before.
    - cratermoon 5y ago
      > it would at least acquaint them with the actual data and categorization systems in use in a very visceral way. These days, especially with people leading tech, I'd fear that exposing them in that way would only lead them to disdain it and complain that it's "ripe for disruption" and decide that two guys with an ML model and VC funding could and should replace it. Even in this forum, look at the comments suggesting GPT-3 could replace the whole shebang. What those suggestions miss is that it would me that instead of needing to know the ins-and-outs of a formal, if flawed, ontology, we'd have to be guessing at what the algorithm applied, and forgetting that it was trained on existing metadata models and has its own metadata.
cratermoon 5y ago
Apropos: Ontology is Overrated -- Categories, Links, and Tags http://digitalcuration.umaine.edu/resources/shirky_ontology_is_overrated.pdf http://digitalcuration.umaine.edu/resources/shirky_ontology_...

98 points by dcminter 5y ago

xwkd 5y ago

I worked for OCLC for about five years, so I have a lot of sympathy for the pains that archivists go through when trying to standardize content metadata. Can't be that hard of a problem to solve, right? I mean, we're only talking about coming up with a good solution for cataloging the sum total of all human knowledge. (Not a small undertaking.) Libraries are caught between a rock and hard place. On the one hand, they have to be stewards of this gigantic and ever growing mound of paper, and on the other hand, they have to deal with the lofty ideas of the W3C and Tim Berners-Lee, trying to connect all of that paper to his early 2000s vision of the ultimate knowledge graph / the semantic web. No wonder we're sticking to MARC 21. The only people using that web for research are universities. The rest of us are using WHATWG's spawn-of-satan hacked together platforms because the technology always moves faster than catalogued content. Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams.

sswaner 5y ago
“old programmers' utopian fever dreams” - accurate description of me when I first found Dublin Core. Never made it to production. It was unnecessary overhead for describing internal content.
ghukill 5y ago
>> "Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams." Greatest thing I've read on HN. As a librarian and developer, can confirm. At least in most cases...(slipping back into fever dream)....
smitty1e 5y ago
Sayre's Law: "In any dispute the intensity of feeling is inversely proportional to the value of the issues at stake." https://en.m.wikipedia.org/wiki/Sayre%27s_law https://en.m.wikipedia.org/wiki/Sayre%27s_law Was there ever a less essential fiefdom than citation formats?
- dsr_ 5y ago
  Have you noticed that search engines suck? Citation formats are an attempt to end up with a search engine that doesn't suck. (They can do lots of other things along the way.) Options: 1. Accept any format and try to turn it into your own internal representation. Problems: (a) your own representation is a citation format; (b) you need to write an infinite number of converters and hire an infinite number of trained people to work out the edge cases. 2. Accept a limited number of common formats. Problem: your search engine will not be useful for a majority of the corpus. 3. Convince everyone that your new citation format is unstoppable. Problems: (a) convincing everyone; (b) actually having that citation format cover, say, 99% of the cases; (c) XKCD#927 (Standards). Dublin Core is/was a terrible attempt at a type 3 solution.
- karaterobot 5y ago
  Some people catalog information every day, so it matters to them for practical reasons. Same with people who rely on those resources being accurately cataloged.
  - smitty1e 5y ago
    I'm ok with obsessing about the data. Presentation, an order of magnitude less. Substance >>> style.
    - karaterobot 5y ago
      Cataloging format is to style as database modeling is to... well, style. It's got nothing to do with aesthetics, it's about describing the data in a way that makes it useful later.
    - 5y ago
lyaa 5y ago
The problem with models like GPT-3 is that they are unable to differentiate between information sources with different "trustworthiness." They learn conspiracies and wrong claims and repeat them. It's possible to feed GPT-3 prompts that encourage it to respond with conspiracies (i.e. "who really caused 9/11?") but it also randomly responds to normal prompts with conspiracies/misinformation. A recent paper[0] has looked into building a testing dataset for language models ability to distinguish truth from falsehood. [0] https://arxiv.org/abs/2109.07958 https://arxiv.org/abs/2109.07958
- pjc50 5y ago
  > A recent paper[0] has looked into building a testing dataset for language models ability to distinguish truth from falsehood. Isn't this a massive category error? Truth or falsehood does not reside within any symbol stream but in the interaction of that stream with observable reality. Does nobody in the AI world know Baudrillard?
  - rendall 5y ago
    It should be at least theoretically possible for an AI to identify contradictions, incoherence and inconsistency in a set of assertions. So, not identifying falsehood per se, but assigning a fairly accurate likelihood score based solely on the internal logic of the symbol stream. In other words, a bullshit detector.
    - nimish 5y ago
      > It should be at least theoretically possible for an AI to identify contradictions, incoherence and inconsistency in a set of assertions Not in the slightest. Likelihood of veracity is opinion -- laundering it as fact to make some people feel better doesn't make it any more subjective, or authoritative.
      - rendall 5y ago
        I think we're not disagreeing, exactly. As a simple example, here is a set of assertions: * The moon is made of green cheese * The moon is crystalline rock surrounding an iron core It wouldn't take an AI to see that both of these can't be true, even if we weren't clear about what a moon is made of, exactly. Some of our common understanding could contain more complicated internal contradictions that might be harder for a human to tease apart, that an AI might be able to identify.
xg15 5y ago
> Hell, at this point, GPT-3 is probably a better approach to knowledge processing than trying to piece together something actionable from a half baked information graph born of old programmers' utopian fever dreams. I mean, at this point, wouldn't it be a lot simpler to go back to the middle ages (or earlier) and have a few humans memorize all that stuff? It's not as if GPT3 would give you any more insight than that approach...
wvh 5y ago
Having worked with DC, Marc21 and some of its precursors, I feel that one major problem with the approach is that cataloguers try to infinitely cut up metadata into ever smaller pieces until you end up with a impossible large collection of fields with an overly high level of specificity and low level of applicability. For example, the middle name of a married name of a person that contributed to one part of one edition of the work in a certain capacity etc. You end up with so much unwieldily specific metadata that consistent cataloguing and detailed searching become nigh impossible. Ever since search engines, the world has moved into using mostly flat search engines rather than a highly specific facet search for deep fields. Of course, one would want something a bit smarter than full text search, but the real, human world is so complex that trying to categorise any data point quickly becomes an exercise in futility.

sgt101 5y ago

Was involved with a project once upon a time that spent six months developing ontologies for event ticketing, not me thank god, but another team of about eight. The delivered ontology got used twice or maybe three times, and it didn't cover all the corner cases we knew about.

smitty1e 5y ago
Heard a bloke introduce himself at the onboarding as a "Sematic Ontologist". His sobriety was only exceeded by his earnestness. I prayed he'd not become attached to my project, as he looked like the sort who could love a problem for weeks without ever reaching a conclusion.
- jdixnneij 5y ago
  Sounds like the eternal student, they just don't work in business, although seemingly I keep getting lumped with the useless persist question askers, sometimes I feel like I discussing shit with David Attenborough, just get on with job ends rant
  - jdixnneij 5y ago
    Truth hurts. Good luck on your third phd
- Vinnl 5y ago
  Oh wow, having interacted with the SemWeb community quite a lot in the past couple of years, > the sort who could love a problem for weeks without ever reaching a conclusion. is such an accurate description of a number of people part of it. Possibly the root cause of all the problems that led to it never taking off at the scale they'd envisioned.
  - tasogare 5y ago
    The semantic web is a non-solution in eternal search of non-problems.

wheybags 5y ago

Was 90% sure this was going to be an article about homelessness in Dublin city centre (the real Dublin, not some imitator in Ohio :p)

blipmusic 5y ago

There are also modular approaches like CMDI [0] out there, that allows for constructing a metadata profile with a corresponding schema [1]. A single metadata standard won't be able to cover all disciplines regardless. Too many free text fields that can't be properly validated. E.g. if you work with documenting minority languages, language ISO codes are vital (assuming one has been created for the language in question). [0]: https://www.clarin.eu/content/component-metadata [1]: https://www.clarin.eu/content/component-registry-documentation

tuukkah 5y ago

These days, you can use Wikidata and the related tooling such as Scholia. Here's a starting point to their ontology, including the difficult details such as the "page(s)" qualifier for the property "published in": https://www.wikidata.org/wiki/Wikidata:WikiProject_Source_MetaData/Bibliographic_metadata_for_scholarly_articles_in_Wikidata https://www.wikidata.org/wiki/Wikidata:WikiProject_Source_Me... Scholia: https://www.wikidata.org/wiki/Wikidata:Scholia https://www.wikidata.org/wiki/Wikidata:Scholia

thinkingemote 5y ago

I think one of the issues is because librarians work with things that have been made and do not change. The catalogues also traditionally did not change, but there's no reason now why this should be the case. If we look at wikidata or openstreetmap for example the way things are categorised changes and evolve, some things stay the same, new things get added, some things get deprecated, and bots or humans can update existing records and machines can handle any deprecations Far better then to start simple, get adoption and update records as you go, I think.

dredmorbius 5y ago
One of the particularly notable things about libraries and catalogues is how much does change. There are on the order of 1--5 million new books published in English each year (about 300k as "traditional" publications, fairly constant level since the 1950s), the largest collections have tens of millions of volumes, the cataloguing technology and standards have changed tremendously over the past 50 years, and the role and usage of libraries themselves is under constant flux. At the same time, budget and staffs are small relative to the total record store. The challenge of organising, classifying, and making accessible all human knowledge has occupied numerous great minds for centuries. We're familiar with Google's take, marrying full-text search with a document-ranking model. That worked relatively well for about 20 years. It's now showing extreme signs of stress. At the same time, much of the past (and present) traditionally-published media is finding its way online, whether the original publishers and established libraries like it or not. LibGen and SciHub may have far more to say about the future of cataloguing standards than the OCLC.
- cratermoon 5y ago
  Oh and how those categories change and are subject to human error and bias. Library of Congress Class D: WORLD HISTORY AND HISTORY OF EUROPE, ASIA, AFRICA, AUSTRALIA, NEW ZEALAND, ETC. Subclass DB: History of Austria. Liechtenstein. Hungary. Czechoslovakia https://www.loc.gov/aba/cataloging/classification/lcco/lcco_d.pdf https://www.loc.gov/aba/cataloging/classification/lcco/lcco_...

PaulHoule 5y ago

Dublin Core was always trying too hard to not be hard to use. It always struck me as a metadata standard for the library at an elementary school. I was amused at how Adobe’s XMP format amended DC used features of RDF that most people were scared to use (ordered collections) to solve the simple problem of keeping track of the order of author’s names on a paper. The big trouble I see with semweb standards is that they stop long before getting to the goal. RDFS and OWL for instance solve some problems of mashing up data from different vocabs but can’t do the math to convert inches to meters which is absolutely essential. I was not so amused to see Adobe thoroughly nerfed XMP and it no longer sucks in EXIF metadata from images. I was hoping I could find the XMP packet and put it through an RDF/XML parsers and get all the metadata from my images but even in Lightroom images the XMP packet is a nothingburger these days. I guess people complained about the GIF files that had 2k of pixel data an 80k of XMP and that Adobe was co-opting other standards. Heck they even deleted most of the content from the standard including how to express EXIF in RDF so you can’t stick XMP in your database and SPARQL it.

blipmusic 5y ago
Depends on what device generates the image perhaps? DJI Drones have a lot of info as EXIF XMP. I just parse that as XML. EDIT: It's not 80k, but good enough as a GPS log.
- PaulHoule 5y ago
  The gif in the story was generated by adobe tools in the bad old days, circa 2005. I noticed the nerfing happened in the last 5 years when I looked closely at what Lightroom does.
  - blipmusic 5y ago
    In terms of wasted space, only 1/8th is actual xmp for that DJI exif chunk, the rest is padding for (13mb jpg:s in our case). 8k, so 1k actual xmp data of which a lot is structural. I've only tried with scripts, verifying with exiftool and a hex editor every now and then.

jiggawatts 5y ago

Dublin Core reminds me of SAML. Designed as a bag of standards parts, not as a complete standard.

amichal 5y ago

Dublin core has always been rough and strange and I’m SURE actual librarians can tell me all sorts of stories about complex things but schema.org has a fine model at first glance https://schema.org/ScholarlyArticle https://schema.org/ScholarlyArticle. Check out the MLA example at the end and how DOI and articles over multiple issues are handled etc.

mark_l_watson 5y ago

I am not sure if I agree with this article. The semantic web and linked data are built using layers of schemas and Ontology’s and changing old stuff is a bad idea because links get broken. Additive systems, instead of creating new versions, will always seem a bit messy. If you look at valuable public KGs like DBPedia and WikiData you will see these layers of old and older schemas. My argument that this is not such a bad thing does have a powerful refutation: the slow uptake of linked data tech and KGs.

mikewarot 5y ago

Back when I was an IT Guy at a small marketing company, I did whatever was asked of me (I'm getting paid, so why not). I got pretty good at data entry, and it's fairly enjoyable. You're not worried about bigger issues than reading scribbles on paper, and trying to get them entered correctly. It is from this experience, that I think they should have done the following: Sit everyone on the committee down down at terminals, and make them do card catalog data entry for a week, just typing into a unformatted text file. After those dues are paid, then you get to participate for the year. I think contact with the data at hand would have rapidly lead to a far better understanding of the required structures.

cratermoon 5y ago
Librarians spend years studying just cataloging to be able to take a publication a library acquires, put a Dewey or LoC number on it, and shelve it, and do it all in a way that makes makes it possible to find it again later when someone wants it. Cataloging is an entire sub-specialty of Library and Information Science. A week of data entry would just scratch the surface.
- mikewarot 5y ago
  I'm not suggesting it would give an encyclopedic knowledge, but it would at least acquaint them with the actual data and categorization systems in use in a very visceral way. In a related way, I find myself watching many of the old IBM videos about mainframes and the punch card systems that proceeded them to have a better feel for what came before.
  - cratermoon 5y ago
    > it would at least acquaint them with the actual data and categorization systems in use in a very visceral way. These days, especially with people leading tech, I'd fear that exposing them in that way would only lead them to disdain it and complain that it's "ripe for disruption" and decide that two guys with an ML model and VC funding could and should replace it. Even in this forum, look at the comments suggesting GPT-3 could replace the whole shebang. What those suggestions miss is that it would me that instead of needing to know the ins-and-outs of a formal, if flawed, ontology, we'd have to be guessing at what the algorithm applied, and forgetting that it was trained on existing metadata models and has its own metadata.

cratermoon 5y ago

Apropos: Ontology is Overrated -- Categories, Links, and Tags http://digitalcuration.umaine.edu/resources/shirky_ontology_is_overrated.pdf http://digitalcuration.umaine.edu/resources/shirky_ontology_...