7 ms·

Here's a link to the actual collection: http://search.getty.edu/gateway/search?q=&cat=highlight&f=%22Open+Content+Images%22&rows=10&srt=a&dir=s&pg=1 http://sear

• mryingster 13y ago
  I won't lie... I came here hoping for a link to the torrent of the entire collection...
  • toomuchtodo 13y ago
    Already working on it (putting together a package for the Internet Archive; might as well put a torrent up as well). EDIT: Scraper running. Should be done shortly (collecting small version, original version, XML data).
    • toomuchtodo 13y ago
      Update: Still scraping, lots of sleep X to be gentle on Getty.
      • dawie 13y ago
        Please post the torrent link once it's done.
        • toomuchtodo 13y ago
          I will.
          • pandesmos 13y ago
            I'm not going to give up hope. I still believe.
            • toomuchtodo 13y ago
              Was at Burning Man, this totally fell off my plate. I'm looking for someplace to put the 100GB zip file up right now.
              • bravura 13y ago
                Amazon S3, requester pays.
              • zz1 13y ago
                Internet Archive?
        • toomuchtodo 13y ago
          Putting the torrent up now. It's ~100GB of content, so give it a bit.
          • ericcoleman 13y ago
            Yay! Link yet?
            • karasinski 13y ago
              Doesn't look like it! Will be excited to see this though.
      • iooi 13y ago
        Do you mind sharing what tool you use to scrape?
        • toomuchtodo 13y ago
          I was rushing, so it was just curl, lynx, sed, awk, all wrapped with bash. Don't judge; I'd use python and a scraping library if I wasn't rushing.
          • fluxon 13y ago
            Thank you for taking the initiative.
    • deleted 13y ago
      [deleted]
  • rogerhoward 13y ago
    They had the S3 bucket originally set to allow listing - I grabbed it all before I reported it to an engineer there. Not going to post a torrent though - mostly cuz you all can figure it out anyhow. The images are all of the form: NNNNNN01.JPG on that S3 bucket. NNNNNN is the object ID (the internal record ID of the work of art) zero-padded to 6 digits. The object ID is the same value that appears, for instance, in the URL on their online collection: URL for Irises: http://www.getty.edu/art/gettyguide/artObjectDetails?artobj=947 http://www.getty.edu/art/gettyguide/artObjectDetails?artobj=... URL for the full-rez image on S3: http://gettylargeimages.s3.amazonaws.com/00094701.jpg http://gettylargeimages.s3.amazonaws.com/00094701.jpg You figure it out :)
    • uniclaude 13y ago
      Nice. That would make a convenient fizzbuzz style interview question.
    • hobs 13y ago
      I dont understand... wouldnt offering a torrent be more friendly than us all downloading it again?
      • 6cxs2hd6 13y ago
        S3 buckets can act as torrents. Source: http://docs.aws.amazon.com/AmazonS3/latest/dev/S3Torrent.html http://docs.aws.amazon.com/AmazonS3/latest/dev/S3Torrent.htm...
        • toomuchtodo 13y ago
          This is exactly how I plan to serve up the compiled archive.
        • hobs 13y ago
          Thats pretty sweet actually, definitely +1. I said my original comment because the idea was to have use learn the power of wget by redownloading all files, which seemed pointless to me.
    • 13y ago
• rogerhoward 13y ago
  search.getty.edu is a Solr-based search index of resources across the Getty, including library catalogs and much beyond the Getty Museum's own collection - just FYI. You can filter for the collection, as well as for objects with images (and objects with open access images). There's also the more focused, but less functional, Getty Museum online collection, which has (more or less) the same museum objects, and also has links to download the images where available. Note, this is ~5000 images out of a collection of hundreds of thousands of objects. This is the easy stuff - public domain objects, with no rights/contract issues, with available, high-quality imaging, fully owned by Getty.