10 ms·

I'm not sure that course completion percentage is necessarily the best metric to be drawing conclusions from. I will often sign up for MOOCs and courses for a s

• lifeisstillgood 8y ago
  These are aspirational course sign ups, and are of course similar to aspirational book purchases (where I will learn a new language through psychic connection between the desk the book is on and the my hands on the desk) and aspirational gym membership (where calories will be burnt simply because my body knows it might go to the gym and so gets all worried and sweaty anyway)
  • komali2 8y ago
    Yea, gym membership is a good comparison, actually. I know tons of people who signed up for a gym and never went, which means we could use the same argument the article does to insinuate that "signing up for a gym on your own is an ineffective way to get fit." Clearly there are more effective (and more expensive) ways to get fit, but some people manage on their own with a gym membership and access to /r/fitness or whatever, so it's not exactly ineffective.
    • InitialLastName 8y ago
      > some people manage on their own with a gym membership and access to /r/fitness or whatever, so it's not exactly ineffective. Some people manage to get fit on their own without a gym membership or any equipment at all, so it's not exactly effective either.
  • realharo 8y ago
    There is also the meme of having a lot of never-played games in one's Steam collection, that were purchased during sales. So it affects entertainment too.
  • MisterOctober 8y ago
    That hits where it hurts! I'm the worst offender when it comes to aspirational book purchases. To the topic: On udemy, I see tons of folks leaving reviews who have purchased hundreds of courses [why udemy displays this info is obscure to me - maybe to generate some kind of courseload-envy?]
• whiddershins 8y ago
  I think that’s a great point. A ways back I took 1/3 of an MIT OCW course and it was incredibly impactful. I guess some would say I should have completed it but that can be arbitrary. I got what I felt I needed.
• the_watcher 8y ago
  I've worked in this industry a bit, and MOOCs rarely use "course completion" as their primary success metric. One reason is precisely what you mentioned - that many people simply take the course for as long as they need to get their desired value out of it, then leave. Another was that the team I worked with found that, by far, the single biggest factor in terms of course completion was that a third party (usually their boss) incentivized them to complete it, and of those people, they were more likely to find ways to skip sections, get the minimum scores required to pass, etc.
  • gmiller123456 8y ago
    So what ways do they measure success? I can attest that I have never started a course just for a few lectures, and I've always planned on taking the whole course. I've quit the majority of courses just because they weren't any good (usually poorly designed homework). I have quite some because they moved on to topics that I didn't find interesting, but I never looked at them from the beginning and said "That's where I'm going to stop". The ones I have completed were ones I thoroughly enjoyed, and felt like I learned a lot. So just from a "course completion" point of view, I'd think it'd be hard to tell the difference between courses I liked, but moved on to topics I didn't like, vs. the ones I just thought weren't any good. But the fact that I stuck with some courses all the way through should at least be good for something.
    • the_watcher 8y ago
      They'll usually _track_ course completion, but it's not necessary for a course to have a high, or even an average completion rate to be a successful course. From what I've seen, they'll track active time spent in course, how much of the course is completed, use quizzes to reinforce learnings while also getting a check in on how actively the student has been taking the course, etc. They also rely on ratings and qualitative feedback. It's not as precise as something like "completions", but from what I've seen it's reasonably effective at assessing course value.
• nicodjimenez 8y ago
  Great point, courses are way too long. If a course could be completed in a day you'd have high completion rates.
  • vezycash 8y ago
    For me, it's the length of individual videos that matter. I prefer those with 4-7 minutes minutes per video. I've noticed that many long videos can be much shorter with minimal editing to remove unnecessary pauses, uhmms...
    • philipov 8y ago
      I'm the opposite. When searching for lectures on youtube, I filter to remove anything shorter than 20 minutes and then ignore anything that's still under an hour.
      • vezycash 8y ago
        On platforms like udemy, the good courses range from 1.5 hours to as much as 97 hours. For this length, the shorter the better for individual videos. For YouTube playlists, the same. However, for one-off youtube tutorial videos, I do long videos as well.
        • ItsMe000001 8y ago
          Not for me. I've taken and completed well over 50 courses by now (took health-related time off work for a few years but when I felt better wanted to do something), and the most frustrating courses where Udacity courses (and a few of the edX courses) where it felt like I had to click Next Next Next Next continuously, could not take my hand off the keyboard and lean back in my chair because there was the next silly easy question to answer and "Next" to click for the next short soundbite video. I definitely prefer well-made(!) longer videos. The worst is when they start each and every 3.5 minute video with a ten second introduction, for those who already forgot what course they are in and what they just heard last only three minutes ago. When I see things like this, or the doctor that I saw yesterday (who didn't know me) immediately switching to a "baby talk" style (for all conversations with her patients, I later observed) I wonder what kind of people (students, patients) they have to deal with in their jobs that they switch to by default assuming the worst.
• dv_dt 8y ago
  Yup, concluding that MOOC formats are more effective is similar to the charter school problem. If you filter for committed people then you end up with better looking success stats. But all it might be doing is finding and filtering those motivated enough to go through a school change process, or willing to put up with some hassle factor of something "online" but still requiring scheduled times, or other commitments. Similar for attendance being a factor for success in the article - it sounded like going in person was the key way to access the extra learning resources. Filtering for the subset of people committed in a certain way isn't really a proof of a good learning format. And to me, not necessarily the best way to bring education to a wider range of students. Filtering for commitment might be argued that it's effective on some level as an efficient use of teaching resources - but I think that needs deeper examination too.
  • MisterOctober 8y ago
    I agree that there's a lot of shaky assertions made about this pedagogical method. From my own perspective, though, on-demand courses like on udemy essentially solve all the problems I hated about classes for my brick-and-mortar university degree. To wit : 1) No distracting interruptions from self-absorbed students asking 'questions' [more often than not, really just statements] that would have better have been reserved for after class / office hours 2) Prof / TA doesn't show up drunk and disorganized 3) If you miss something while taking notes, no sweat -- just rewind and listen again! As a copious note-taker, this is huge for me. 4) Flexible class times keep me much more healthy [can get sleep when needed, etc] 5) No travel time, finding a seat, wanting to talk to a girl instead of focus on lecture, etc etc with all the frustrations / inconveniences that are just not there in online courses I could rattle on a lot more, but ca suffit for now
• thinkmassive 8y ago
  I’m taking two courses on Coursera right now but only paid for a certificate in one. I plan to view all content from the other course, however Coursera will not grade the end-of-section quiz for non-paying students. It seems the only way to “complete” a Coursera course is to pay $50 so the assignments will be graded. At least this is the case for: https://www.coursera.org/learn/battery-management-systems https://www.coursera.org/learn/battery-management-systems
  • scarface74 8y ago
    What’s the purpose of the actual certificate? As someone who has done dozens of interviews - I’m not a manager, but for about two years I was responsible for hiring and I’ve sat as part of a panel- most people don’t take most certificates seriously. Some, including myself, take it as a slightly negative signal. I’ve seen too many paper tigers. But then again, except for entry level positions, few hiring managers care about any formal education for IT positions. From what I can gather, the few certificates that companies care about are RedHat, Cisco, and AWS certs. I’m sure there are a few more that are outside of my area of expertise. I went through the Microsoft Architect Certification track as a commitment device to force me to study, but I didn’t put it on my resume and never told my employer. But I was trying to transition from a C/C++ bit twiddler to an “Enterprise Developer”.
    • boojums 8y ago
      If you don't mind me asking, why did you want to change from bit twiddling to enterprise?
      • scarface74 8y ago
        Money and optionality. 10 years ago after staying at one company for 9 years and before that at another for three doing mostly C and C++ with a smattering of VB6, Perl, and JavaScript, I looked at where most of the jobs were in my local market - a major metropolitan area with a lot of Enterprise Java/.Net and web jobs. I had two offers one for $20K more than I was making as a C++ developer and one as a high entry level .Net developer paying only $7K more (yeah wage compression is real). I took the second offer. I knew in 3 years my options were going to be limited for C jobs. 10 years and 4 additional jobs later and making $70K more, it was the right decision. There are very few jobs making what I make now in my local area for C developers, plenty for “Enterprise” developers/architects. Going back on topic about certificates, I’m again at the same crossroads. I got to where I am being mostly a backend developer/architect with very little modern front end experience. Also, in my local market, “full stack web developers” are becoming a commodity and make less than I do now. So along with learning $frontend_framework_of_the_week just to check off the box, I’m working on AWS certs, since they are still marketable and the only way I can make the next jump without going into management is by being an overpriced “implementation consultant”.
• Kagerjay 8y ago
  I do this all the time as well, I audit the entire course quickly to see what gaps of information I don't know. Or search out a specific topic only, on something I struggle with
• soneca 8y ago
  I agree that course completion might be a very flawed metric. I made a career transition to software development and the resource that had the most impact, by far, in my learning was freeCodeCamp. At the time FCC had only 3 certificates (now is 6 I guess), but I only completed the first one - Frontend.
• anonymous5133 8y ago
  Course completion metric is one of the worst metric to use to evaluate online courses/MOOCs. It is quite obvious that for other forms of traditional there is an investment that is being made by the student so of course they are encouraged to keep going. People spending money on something is a signal that they are highly motivated to take the course. For MOOCs, there are very few entry requirements so of course you can going to get low completion rate because lots of people are just "window shopping" so to speak.
• bcheung 8y ago
  Agreed. I notice that many MOOCs have this academic mentality that something must be complete and a certificate earned. I could really give a damn about a certificate. Gaining the knowledge I need is all I care about. Udacity really makes me mad when they remove courses that I paid for if I don't do every little exercise (even the ones that are so horribly designed and have little learning value in them).
  • ska 8y ago
    Gaining the knowledge may be all you care about, so long as you never have to demonstrate that gain. Certificates/exams/etc. are all used as proxies for demonstrating that in a complex and expensive way. Perhaps Udacity et. al. need an equivalent to "audit" - sounds like that would work for you.
    • gaius 8y ago
      EdX has this - courses are free to audit, you only pay if you want a certificate (but you can always screenshot your progress page)
    • bcheung 8y ago
      It was more the removing access to a course that I paid for if I didn't follow their schedule that really upset me.
      • ska 8y ago
        ah, that's fair enough. annoying.
    • deleted 8y ago
      [deleted]
    • JamesBarney 8y ago
      This seems like a valid criticism to removing a certification but not access to a course.
• SonnyWortzik 8y ago
  quite common. Many of my colleagues including myself will sign up for a course online only because we saw an interesting topic in one of their modules. We go straight for the module, learn what we want and move on, never complete the course.
• blihp 8y ago
  I'm the same way but I think people like us tend to be heavily over-represented on HN and probably represent a small fraction of the total audience. Similarly, I like to watch YouTube videos for specific technical content where the vast majority seems to prefer pop culture and cat videos. A couple of other personality types / situations to consider: 1) Some people treat learning the way they treat a workout... procrastination is the path of least resistance. So metrics like course completion % 'gamify' it for them to give them the push they need to keep motivated. 2) In the business world, think of the times someone has said 'I'm not trained in that' (or something along those lines, often to try to get out of doing something) and the boss says 'well, go get trained in that.' Course completion is a thing that can be shown to said boss to 'prove' they learned something. While self-learners would tend to keep their mouths shut about not knowing it and say 'sure, no problem' and then go find whatever training materials were needed to learn said thing.
  • jjeaff 8y ago
    I was thinking about this the other day. The idea that most people are just watching garbage on YouTube 'might' be true, and that viewing educational or technical content is an outlier, but I'm not so sure. Sure, there are countless massively popular channels with garbage pop content, but that may be due to the "general" nature of the content. The broad audience keeps it at the top of the most watched lists. I think if you aggregate all the technical content, the "long tail" might be more numerous than the hump of the curve. There are channels about programming, woodworking, plumbing, HVAC, construction, 3d printing, PC building, electrical engineering, mechanical engineering, knitting, photography, cinematography,graphic design ... it just goes on and on. Sure, most of those channels may only have a hundred thousand or fewer subscribers (with some exceptions in the millions) but I wouldn't doubt that in aggregate they surpass junk like moviemojo and cat videos in time watched. Youtube is an amazing phenomenon that I think doesn't get enough credit because of all the junk on there, but the fact that I can search for how to remove the abs module on a 2007 BMW 750li and get multiple videos showing how to do it just blows me away and definitely makes it a lot easier to get things done.
    • InitialLastName 8y ago
• just_myles 8y ago
  You're not. I only ever need specific portions that I can't get on youtube tbh. I don't agree with the assertion that attendance makes a better student. We all learn on the job at some point and that is where the real learning begins.
• rhizome 8y ago
  Not to mention that if you watch anything at Khan Academy, they jiggle the page and nag you every 30sec to log in to save your progress (even when you dismiss the notification).
  • MisterOctober 8y ago
    Taking this opportunity to gripe about KA : I took their intro to chemistry, and the production quality of the videos was so erratic that I thought it might be a joke -- e.g., first video disjointed, second coherent but sounded like it was recorded over a '50s telephone, etc etc. Hate to look a gift horse in the mouth, but this one needs a housecall from the vet
    • ItsMe000001 8y ago
      Would you have a link? I found those videos that I did watch pretty good, definitely not lacking in quality. That was mostly math, just a few chemistry videos (some 20?).
      • MisterOctober 8y ago
        Yep! The first few videos here -- https://www.khanacademy.org/science/chemistry/atomic-structure-and-properties https://www.khanacademy.org/science/chemistry/atomic-structu...
• Chathamization 8y ago
  Indeed. Also some platforms (I believe Coursera and EdX were like this last time I used them) only let you access old content if you signed up with a course when it was active. So you are incentivized to sign up for any course if you think there's a possibility that you might want to access some of the content at some point in the future. People shouldn't confuse completion rate with a particular course with a student reaching proficiency in a particular subject. There have been several courses I've started were I quickly got annoyed by the copious amount of filler in the lectures and dropped the course in favor of a book or web tutorial. In general I think MOOCs are doing themselves a disservice by trying to copy college courses.
  • alexgmcm 8y ago
    >In general I think MOOCs are doing themselves a disservice by trying to copy college courses. I agree completely - it seems almost 'cargo cult' - they are just copying colleges assuming it will be successful rather than examining what it was that made that work for colleges and how they can adapt it to the MOOC model.
• ndnxhs 8y ago
  I have signed up for online corses just to see what the content actually is before deciding if I want to do it.
• Alex3917 8y ago
  Right, signing up for a MOOC is basically just a way of bookmarking it. It’s not really any different than how most people don’t buy all the stuff they add to their Pinterest boards.