6 ms·
In case you want to download as may courses as possible before they fade away, here are some notes. Please forgive me some mistakes, I wrote this a bit in a hu
by znpy 10y ago
In case you want to download as may courses as possible before they fade away, here are some notes.
Please forgive me some mistakes, I wrote this a bit in a hurry.
===========================
1) Spawn a virtual server on DigitalOcean.
I am using the 40$/month in order to have 40GB of space, but my plan is
to shut it down in a day or two.
The advantage is to have storage space AND super-fast connection.
If you don't want to spend money, here is my referral code:
https://m.do.co/c/867be540644c https://m.do.co/c/867be540644c
This will give you 10$ credit for free.
2) Install screen, python-virtualenv, python3, python3-pip
3) edit ~/.bash_aliases:
#!/usr/bin/env bash
alias download="./coursera-dl -u <<username>> -p <<password>>"
alias download_preview="./coursera-dl -b -u <<username>> -p <<password>>"
4) Install coursera-dl: see https://github.com/coursera-dl/coursera-dl#alternative-installation-method-for-unix-systems https://github.com/coursera-dl/coursera-dl#alternative-insta...
name the virtualenv "coursera", and place it in the root home directory
5) patch to use python3:
* pip3 install -r requirements.txt
* patch coursera/coursera.dl:
#!/usr/bin/env python
# -*- coding: utf-8 -*-
Becomes:
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
6) Edit ~/.bashrc
Add this lines at the end of the file:
cd coursera
source bin/activate
cd coursera
=======================
The setup process is done. Here is how to use it:
1) Start a screen session: `screen -S coursera`
download_preview compilers-004
you can download more courses in parallel by creating another window (C-a c) and typing donwload_preview $coursename.
- znpy 10y agoTested and successfully downloaded (about 30GB): - recsys-001 - hwswinterface-002 - eefun-001 - experiments-001 - gametheory-003 - crypto-010 - pgm - cariesmanagement-003 - algo2-003 - analyze-003 - audio-002 - ml-005 - sna-2012-001-staging - spatialcomputing-001 - organalysis-003 - compilers-004 - modelthinking-006 - ggp-003 - algo-009 - intrologic-005 - automata - linearopt-002 - matrix-002 Please add below this comment other coursed that can be downloaded.
- akvar 10y ago- neuralnets-2012-001 - scicomp-003 - mmds-002 - comparch-003
- mziel 10y agohetero-004 algs4partI-010 algs4partII-007
- mkl 10y agoHow are you finding out the course names?
- rahiel 10y agoIt's part of the course URL when you're enrolled at the course home, e.g: https://class.coursera.org/algs4partI-010 -> algs4partI-010 https://www.coursera.org/learn/machine-learning/home/welcome -> machine-learning (see https://github.com/coursera-dl/coursera-dl/wiki https://github.com/coursera-dl/coursera-dl/wiki)
- dhawalhs 10y agoMade a list of 220 courses that are still open for enrollment: https://docs.google.com/spreadsheets/d/1kaWxZG3krI83WfdzlExWL-_S5UBai-CYuofGR5DZcd0/edit?usp=sharing https://docs.google.com/spreadsheets/d/1kaWxZG3krI83WfdzlExW... I will work on figuring out the slugs next. For you now, you will need to signup for the course and figure it out. You can also find the same the list on Class Central where you can filter by subjects or sort by rating: https://www.class-central.com/collection/coursera-old-stack https://www.class-central.com/collection/coursera-old-stack
- raybb 10y agoIf you go the page where all your archived courses are and run this code it'll give you a list of the slugs :) //////////Grab archived urls var archived = document.getElementsByClassName("link-button primary"); var archivedUrls = []; var slugs = []; for (var i = 0; i < archived.length; i++){ archivedUrls.push(document.getElementsByClassName("link-button primary")[i].href); } ////////////////////////////// function getDatas(LLL){ $.ajax({ url: LLL, dataType: 'text', success: function (data) { var re = /F[a-zA-Z0-9-]*-0\d{2}/; var info = data.match(re)[0]; var fixeInfo = info.substring(1); slugs.push(fixeInfo); console.log(fixeInfo); } }); } var ii = 0; // set your counter to 1 function myLoop () { // create a loop function setTimeout(function () { // call a 3s setTimeout when the loop is called console.log(archivedUrls[ii]); getDatas(archivedUrls[ii]); ii++; // increment the counter if (ii < archivedUrls.length) { // if the counter < 10, call the loop function myLoop(); // .. again which will trigger another } else { console.log('Type "slugs" to view all slugs gathered'); } }, 1000) } myLoop(); // start the loop
- raybb 10y agoHere is a link to updated code to do this: https://github.com/RayBB/coursera-slug-extractor https://github.com/RayBB/coursera-slug-extractor
- raybb 10y agoHere's a list of slugs for almost all of the courses! https://docs.google.com/spreadsheets/d/1W1PZEQbb1jnNh-EeFUoBUOhv0VwLQF7x-XZ2uxn80gM/edit#gid=0 https://docs.google.com/spreadsheets/d/1W1PZEQbb1jnNh-EeFUoB...
- fosco 10y agowhere can I get these and share? please let me know
- drxyzzy 10y agoeqp-004
- cgrubb 10y agoMy downloads: - ac-005: Analytic Combinatorics - aofa-006: Analysis of Algorithms - neuralnets-2012-001: Neural Networks for Machine Learning - nlp: Natural Language Processing
- tdullien 10y agoHey there, I was enrolled in the 2013 edition of Analytic Combinatorics, but it seems that I am out of luck - no access to the materials either way. :-/ Does anyone happen to have the name of the 2013 edition? Or is it by design that these can no longer be accessed?
- fao_ 10y agoIs there any chance of you uploading any of these to something like mega and allowing people do download them?
- macmac 10y agoI am getting a 404 for the algo2-003, but the others work fine.
- ikeboy 10y agoCan someone get the archive team on this?
- glogla 10y agoI don't think that would be legal. Coursera ToS definitely prohibits something like this. I can see a case for a torrent with the courses mysteriously appearing on some torrent site and someone linking it here, though. Man, those cheeky pirates! They can't leave anything alone. (I don't personally have bandwidth for something like that, sadly. Of course I'm also not a pirate.)
- rpgmaker 10y agoA violation of the "Coursera ToS" doesn't imply that something illegal was done. But even if it did I doubt that it would carry any weight outside of the US.
- joe563323 10y ago> I don't think that would be legal. Coursera ToS definitely prohibits something like this. Have some heart. This is completely Ethical. What about millions of people around the world who does not even have bank account to pay. Remember the authors does not get screwed. Their life will not get modified drastically. Only the undeserved people who are making money out of them.
- j_s 10y agoI wouldn't be surprised if they already had it. It would (unfortunately) be surprising if they chose to redistribute it, though.
- znpy 10y agoI would like to point out that I am only downloading such content for my personal use, and I am just helping other people do the same.
- raldu 10y agoSo why not share all the downloaded content through a p2p torrent network, rather than to keep them in our own servers to ourselves, so that everyone else benefits?
- shock 10y agoThe Coursera TOS prohibit this. Specificaly, "You may download content from our Services only for your personal, non-commercial use, unless you obtain Coursera's written permission to otherwise use the content."[0] [0] - https://www.coursera.org/about/terms https://www.coursera.org/about/terms
- komali2 10y agoThat's fine, but so why don't we? If the whole purpose of downloading all these courses is so that we can continue to access them after Coursera goes full moneygrub mode, surely someone is willing to sacrifice their Coursera account for this?
- joe563323 10y agoLets think about it from ethical stand point. The kind of people who downloads and wants to learn is just a very tiny fraction of people in the entire tech population(Even most people in tech industry does not want to invest in learning). Their contribution will be significant. So what about the hard work the authors who had put in to create the course ? Don't worry their life will not be affected much(not like they will miss being billionaire). The only people who might get affected is the undeserved people who is taking advantage of intellects like the university.
- userbinator 10y agoToS and even copyright law never stopped SciHub and LibGen. An old saying I remember from my days in the ebook scene: "Those who want the knowledge will always find it."
- znpy 10y agoAs someone else pointed out, that is not allowed by the TOS. But quite frankly... now that such content is not freely available anymore, I expect that to begin circulating on the p2p networks anyway.
- deleted 10y ago[deleted]
- babo 10y ago- algo-005 - nlp - machlearning-001 - maththink-004 - mmds-002 - pgm-003 - gametheory-003 - compilers-003
- bburky 10y agoIf anyone wants these steps fully automated you can use this script: https://gist.github.com/bburky/40317e6375b1262b1a1fc31072acf496 https://gist.github.com/bburky/40317e6375b1262b1a1fc31072acf... Just use it as a User Data file on DigitalOcean or elsewhere. Edit: After doing this, I realized coursera-dl has a Docker script already. You may prefer it: https://github.com/coursera-dl/coursera-dl/tree/master/deploy https://github.com/coursera-dl/coursera-dl/tree/master/deplo...
- znpy 10y agoAwesome. Just awesome.
- znpy 10y agoA complete list of the courses cited so far in this thread can be obtained via this shell one-liner: curl "https://news.ycombinator.com/item?id=11881767" | grep -Po "[a-zA-Z0-9-]*-0\d{2}" | sort | uniq better: curl "https://news.ycombinator.com/item?id=11881767" | grep -Po "[a-zA-Z0-9-]*-0\d{2}" | sort | uniq | awk '{print "# " $0}' You might might want to update your script :)
- bburky 10y agoDone.
- collinmanderson 10y agoThank you for using Python 3. :)
- znpy 10y agoI was thinking that it didn't come to my mind to sit down and download as much content as I could from courses because it was freely available. What I realized is that even on the internet nothing lasts forever, and that I should always download stuff I like, just in case...
- shareknowledge 10y agohttp://pastebin.com/ESiirEjU http://pastebin.com/ESiirEjU list of available courses, in format: course_session_id, course_link
- shareknowledge 10y agofound that list contained closed for enrollment sessions, new list http://pastebin.com/1N8ijd7p http://pastebin.com/1N8ijd7p
- mmishu 10y agoCan I do this with plural sight courses?
- vardhanw 10y agoI found this useful https://www.quora.com/What-are-the-ways-to-download-videos-from-PluralSight https://www.quora.com/What-are-the-ways-to-download-videos-f.... Of course it works only if you have an account.