8 ms·
Gallery-dl – download images from several image hosting sites
- submeta 6y agoExcellent. Thanks for sharing. - Beautifully coded in Python.
- marwan-nwh 6y agoThe first link in homepage with just 8 points and zero comments?
- Triv888 6y agosome posts gets boosted by a greater force
- airstrike 6y agoGlad to see ArtStation is included. Might finally give me enough impetus to write a script to change my wallpaper daily
- aomega08 6y agoThe following will give you "#1 wallpaper of the day" as decided by the wise folks at Reddit: curl -A 'random' "https://www.reddit.com/r/wallpaper/top.json?t=day&limit=1 | jq -r '.data.children[0].data.preview.images[0].source.url' | sed 's/preview\./i\./g' And if you're a Mac user, the following will change the background: osascript -e 'tell application "Finder" to set desktop picture to POSIX file "<path to the picture>"' Glueing these two pieces should be trivial :)
- hyiltiz 6y agoThe call to curl is missing a closing " pair. Besides, it seems some people submit a low-res image at the post, then post another link as the first reply, which is the case today: https://preview.redd.it/b2ihaxu2i5261.jpg?width=640&crop=smart&auto=webp&s=acd298fea12feda494d287a48105faa120677026 https://preview.redd.it/b2ihaxu2i5261.jpg?width=640&crop=sma... Care to adjust the jq a bit to look for both, then maybe somehow compare the resolution of the two and download the better one?
- egeozcan 6y agoNot to take anything from how great it is to have something like this, some of the supported sites have heavy rate limiting and bot detection and using this with your account can easily get you banned. For example, I had immense difficulty parsing my own saved posts from instagram (used a one-off script that runs in the browser).
- toomuchtodo 6y agoDoes Instagram not have an export function (similar to Facebook) for personal data to comply with CCPA and GDPR? If not, they should be reported to the appropriate regulatory bodies to encourage such an export function. Disclaimer: I don’t have or use Insta, so apologies if this is a naive question.
- a254613e 6y agoThey do. You can easily get all your photos, chats, etc using that feature. https://www.facebook.com/help/instagram/181231772500920?helpref=hc_fnav https://www.facebook.com/help/instagram/181231772500920?help...
- deleted 6y ago[deleted]
- hprotagonist 6y agoah, but i want a tarball of every photo/photogallery that i have liked. This seems to just be what I’ve ever posted.
- dtien 6y agonot sure if this is sarcasm, but photos you liked aren't yours so this would be violating their privacy rules.
- hprotagonist 6y ago
- Rolpa 6y agoThis strikes me as the FOSS equivalent of trying to piss off the volcano.
- drsozesakamoto 6y agoWhat volcano ? The RIAA ?
- bigbubba 6y agoI guess the photograph 'volcano' would probably be Getty.
- pbowyer 6y agoDoes anyone know of a downloader that works for private Facebook Groups? I'm a member of some local history groups and the material posted is amazing. I'd like to refer to it in the future, likely long after the posters are gone. I can't rely on Facebook being around then. Copying and pasting into a personal archive is slow when you want to capture everything (posts and comments) since you don't know which history you'll want to refer to in the future.
- BugWatch 6y agoI don't know of any solutions, but would like to add that I am interested in one as well.
- RamRodification 6y agoThere are browser extensions that simply lets you save all (or some selection of) images that load on a website. Maybe that's good enough if you can't find one that has proper support for Facebook groups. I imagine you could quite quickly just click through the material and save it. Won't work for text or metadata like descriptions/titles I guess...
- blt 6y agoScraping images is not enough. There's still pagination to deal with. It's also important to scrape the post text and comments.
- toomuchtodo 6y agoMind if I reach out to you via your contact info? I can get this into the Internet Archive.
- BugWatch 6y agoHm, I couldn't find the list of supported sites. Is Pinterest covered? Or does anyone know of similar working tools that would work for Pinterest? As a means of "backup" and/or sync with Pinry.
- pantulis 6y agoIt’s here https://github.com/mikf/gallery-dl/blob/master/docs/supportedsites.rst https://github.com/mikf/gallery-dl/blob/master/docs/supporte...
- tholford 6y agoNice work! Made something similar (and less feature-rich) using Deno: https://github.com/tomholford/media-downloader https://github.com/tomholford/media-downloader
- paulcarroty 6y agoCool project. Why download from Facebook isn't supported yet? Does FB use any protection for his content?
- ffpip 6y agoFB (and instagram, whatsapp) do something weird with all media files. They assign a unique ID to each image/video/file and they don't let you download if you try to remove that ID or change it. It changes every time you reload the page. Maybe something to do with that. Plus there is also massive rate limiting. Especially instagram, since it is only images.
- utxaa 6y agoah ok there's xhamster. for a second there I thought this was useless.
- dismantlethesun 6y agoThere's also one for Luscious.net; they basically have all the major h-sites and x-sites. I imagine that that's a big source for people to download.
- siliconmountain 6y agoI would like to find the same thing for online ebook/textbook readers that University websites use. Suggestions? Every online reader I've used ProQuest, VLE, BCR, etc offer the worst online readers with frames, annoying 15 minute timeouts, terrible highlighting/notes, etc I just want to print or download a local copy to highlight & full text search offline (I run them through OCR for text)
- IngvarLynn 6y agoOne obvious issue with both these downloaders is lack of proper modularization. Which greatly hinders adoption, I believe. I would expect some kind of plugin system. Naturally, there are attempts to fix that: https://github.com/un-def/dl-plus https://github.com/un-def/dl-plus is one example. As a bonus that would help greatly with recent youtube-dl sort of situations and RIAA would have barely made a splash. Plenty of other features immediately come to mind as well: universal media support, proper parallelism, GUI, desktop integrations, proxies support, anti-captcha... The punchline is: all of this and much more you could find in jdownloader 10 years ago. But somehow youtube-dl won that race. How did that happen?
- bigbubba 6y agoJdownloader has the aesthetic of sketchy windows freeware from a bygone era. I tried it once, then uninstalled it a minute later. youtube-dl also integrates well with other tools or autonomous workflows; for example mpv invokes it to stream media from the web without downloading it to the disk.
- Hello71 6y agoit is sketchy windows freeware. https://en.wikipedia.org/wiki/JDownloader https://en.wikipedia.org/wiki/JDownloader, https://support.jdownloader.org/Knowledgebase/Article/View/adware-during-installation https://support.jdownloader.org/Knowledgebase/Article/View/a...
- benibela 6y agoI always run it under a separate user account because it looks so sketchy I thought it was sketchy by association. It used to be always recommended by sketchy pirate sites to bypass the download limits on sketchy one-click-hosters
- bigbubba 6y agoHuh, I thought it was properly FOSS albeit with a plea for subscriptions, but that's much worse. Evidently my gut instinct was right.
- mixmastamyk 6y agoCool tool but for some reason reason I was expecting more support for museum and library galleries and less for porn sites. :D I guess they’re already downloadable though a command line tool could be convenient.
- nonbirithm 6y agoI wrote something similar, but for the purpose of saving material to a personal image board while using a mobile device or browser, using a web service architecture. This means you don't have to use a terminal every time you want to save an image, and several different clients can be used without needing to rewrite the extraction code for each one. It also saves the original tags if the source supports them, which makes everything way more searchable. But this new program has a lot more site support than mine. We need good wrappers for these kinds of programs for use with mobile devices. https://github.com/Ruin0x11/szurupull https://github.com/Ruin0x11/szurupull
- nikisweeting 6y agoOoh this looks great, I think it would work well as an extractor in ArchiveBox next to youtube-dl.
- infinyte7 6y agoRecently I read about pyodide (WASM). Can it run in browser using pyodide also?
- blindm 6y agoInteresting that the list of image upload sites is a who's-who of sites. Always looking for alternatives to Imgur which is laden with ADs and doesn't work with an AD-blocker turned on (it explicitly asks you to turn it off)