8 ms·
Enough Machine Learning to Make Hacker News Readable Again [video]
- deleted 12y ago[deleted]
- dkarapetyan 12y agoI actually did something like this at some point. I took all the high ranking items, tokenized them to extract features, and ran them through a bayesian classifier to do some filtering. I was just using whatever information was available on the front page and did not do any further analysis with the actual content. The results were ok. Maybe with a bit more power it could be more useful but the results were still hit and miss and I didn't have a long term strategy for not filtering myself into a bubble other than continuously re-training the model.
- mjfl 12y agoVery block-boxy ("and it does a whole bunch of math and voila!")
- tdicola 12y agoIsn't that the point of tools like scikit-learn? You don't need to know how to code, optimize, etc. all the algorithms, just understand how to use them.
- mjfl 12y agoPerhaps, but I feel like if you are trying to use a statistical tool, it would be best to know how it works. Think about if every scientist claimed a discovery when they found a result with a 90% confidence interval. Machine learning (at least in this application) is different because often the consequences are testable, verifiable, but I still think that it's better to know how it works than treat it like a black box.
- 3rd3 12y agoThere is probably a large group that lacks advanced linear algebra and statistics for learning the theory but would still be able to build useful applications using a ML library. I think the video is mainly directed at that group.
- andreasvc 12y agoWhat makes you assert he is treating it like a black box? There isn't time in the presentation to go into detail, but actually linear models are inspectable, namely, you can obtain a list of features and how they are weighted. Also, as he said, the scikit-learn documentation is of high quality and explains how the models work. BTW you give an example of scientists, but like he stressed, machine learning as he applied it is a form of engineering.
- ColinWright 12y agoYes. So are compilers. And web frameworks. And editors. And memory-management tools. Progress is made by no longer re-implementing and re-inventing the things that many, many people have invented and implemented in the past, and building on their work. This doesn't mean that there is no value in learning about these things for yourself, but the packaging of knowledge in reusable tools is the only way programming progresses.
- Dewie 12y agoNicely encapsulated doesn't have to imply a black-box implementation, though. I for one would like it if compilers were less black-boxy; ideally, I want to find out why my compiler does a particular thing by investigating its output, querying the API, going through the compilation steps, etc., rather than having to google some StackOverflow answer.
- skj 12y agoblack box, not block box.
- _archon_ 12y agoI didn't even see that at first, although now that I look at it... I kind of like the term "block box". It takes a black box, and defines it in terms of how it's used, not what it does. It is a block that can be implemented in a certain way. How does it work? Doesn't matter at this level. It's a building block for a differently-focused project. A block box.
- pygy_ 12y agoHere's the result of the presentation: http://hn.njl.us/ http://hn.njl.us/ The classifier rejects this very submission... not sure what to think of it. Maybe the "[video]" label killed it? The fact that it references HN?
- ColinWright 12y agoMore likely the retrieved text fron the page itself contains very little of technical interest. If there were a transcript I expect it would fare better. Great reminder - material in a video is undiscoverable.
- egwor 12y agoJust my 2c; I can often get data faster by reading than waiting for someone to explain it verbally, so I usually prefer not to watch videos. If someone could automatically transcribe videos with key panes from the video... (google??) ... then that would be cool.
- 001sky 12y ago^^^agree with this
- CatMtKing 12y agoProbably just doesn't want to hear himself talk ;)
- GhotiFish 12y agoHis algorithm rates this article as bad. That is very funny.
- swalsh 12y agoThis guy right here made watching the video worth it: http://i.imgur.com/twr2j8Y.png http://i.imgur.com/twr2j8Y.png
- platz 12y agoWhy is it that in genetic algorithms never seem to be mentioned any more. Are they sub-standard, or just a "higher-level" than typically talked about i.e. you must implement them yourself.
- Russell91 12y agoGenetic algorithms are not really an off-the-shelf black box that you can just plug your data into and get results. They take a domain expert to use efficiently, and even then they aren't guaranteed to perform that well. The area that I've encountered where they are most effective is in approximation heuristics for NP-hard problems where you slowly assemble a solution from smaller pieces.
- mendicantB 12y ago+1 I'd also add that genetic algorithms are for optimization, and can't really be compared with most of the algorithms in that chart. It'd be a sub-level where different optimization techniques for finding model weights, for each type of approach (classification, clustering etc)are compared.
- simonster 12y agoMost (all?) of the algorithms on the chart iteratively optimize an objective. However, most of the objectives are convex or otherwise admit an optimization strategy that performs better than a genetic algorithm.
- mendicantB 12y agoI believe you are repeating what I said (?). All of the algorithms have different methods of arriving to an objective function and leveraging it's results. Yet, most share the same problem in terms of optimizing it, and yes, most choose other routes.
- nostromo 12y agoCool project! But HN to me is a way to keep current on what people in tech are talking about. I don't want to live in a bubble. I want to discover new things that smart people think are cool.
- tannerc 12y agoSomething that keeps bringing me back to HN specifically (over the likes of Reddit, Twitter, etc.) is the sheer intelligence of conversations. More often than not I'll find myself skimming through the discussion here before exploring the linked material. The reasoning behind why people feel something deserves to be "front paged" and the insights that domain experts offer in the discussion is what (I feel) makes HN valuable. Taking away the brainy aspect behind how the community works would be an interesting experiment, alas one I wouldn't want to see _replace_ what we have today. "Things smart people think are cool" is nearly an understatement.
- gabemart 12y agoThis is exactly what people on reddit used to say about reddit six or seven years ago. I have to believe the decline in general quality, and the quality of the front page most of all, in reddit could happen in some form to HN, without vigilance on the part of users and mods.
- krapp 12y agoIronically, dang himself just got accused of posting something "not worthy" of HN: https://news.ycombinator.com/item?id=7712692 https://news.ycombinator.com/item?id=7712692 There seems to be a remarkable difference between what people feel HN should be, and what it actually is. "Quality" seems to be more of a sliding scale which correlates to personal bias, and perhaps, a feeling of alienation brought about by a diverse community, than anything objective.
- mey 12y agoThe community will drive to a common form which is shaped by the community managers (mods and power users). I believe @pg gets that and the people taking over also get. Additionally some users may simple outgrow the community even if the community stays exactly the same. I think HN gets a lot of things right to foster what I enjoy, which is intelligent conversations about a wide variety of forward looking topics. I think the biggest risk at the moment is spamming the site with what are essentially targeted ads/click bait because of the user base is, but for the most part the front page is decently curated.
- harrystone 12y agoAre people really serious when they talk about the fabled Hacker News of old? What could it possibly have been like? I'm imagining something like zombo.com, only with lower contrast text.
- drblast 12y agoThe way I remember it, it was like this site but more frequently updated and focused mostly on Haskell: http://lambda-the-ultimate.org/ http://lambda-the-ultimate.org/ If you read a few rows down on that page, you'll see this: "For the debate about MS being evil, you can head directly to HN where you'll also find an explanation of what bootstrapping a compiler means." And that about sums it up. For a while I didn't even create an account because I didn't think I could add anything without sounding stupid compared to everyone else. Now I try to refrain from commenting for...different reasons.
- saraid216 12y ago> And that about sums it up. For a while I didn't even create an account because I didn't think I could add anything without sounding stupid compared to everyone else. Now I try to refrain from commenting for...different reasons. Same here. Though I refrain less. At some point, I'd like to go and find my first comment on here just to see what got me to make an account.
- icebraining 12y ago
- soundoflight 12y agoInteresting enough... the greens are all ones I clicked on earlier today and read. A few false negatives but not bad!
- ff_ 12y agoAnd the most beautiful thing here is that his classification algorithm marks this entry as "Probably I shouldn't read this" I love it: http://hn.njl.us/ http://hn.njl.us/
- philsnow 12y agoIdea: browser extension that notices two things: when you follow links from the HN front page, and whether you upvote that story. If you read an article and don't upvote it, it labels that article "dreck". If you do upvote it, it labels that article non-"dreck". Maybe it has some subtle reminder that you should remember to upvote the article once you're done. People who use this extension make HN better for themselves (because they're classifying articles according to their tastes as they go along) and they're also making HN better for others (by incentivizing people to upvote good material when they may otherwise have not upvoted). If you have enough HN karma to downvote, maybe only downvotes count as dreck. Then you're still improving both your own and others' experience. Yo dawg, I heard you like HN, so I proposed a browser extension that lets you improve HN while you improve HN.
- dredmorbius 12y agoTwo general problems with this, and they're common to many content-recommendation / filtering systems. • Explicit rating actions are only a small part of interactions with a site. Other implicit actions are often far richer in quantity and quality -- time spent on an article, interactions and discussion, the quality of that discussion (see pg's hierarchy of disagreement, for example), and other measures. As Robert Pirsig noted, defining quality is hard. • Whose ratings you consider matters. The problem of topic and quality drift happens as general interests tend to subvert the initial focus of a site or venue. Those which can retain their initial focus will preserve their nature for a longer period of time, but even that is difficult. Increasingly, my sense is that you want to be somewhat judicious in who you provide an effective moderating voice to, but those who get that voice should be encouraged to use it copiously. Policing the moderators (to avoid collusion and other abuse) becomes a growing concern (see reddit and its recent downvote brigades against /r/technology and /r/worldnews).
- philsnow 12y agoregarding the first part, granted. regarding the second part, the proposed scheme uses hn's built in control of making users earn a bunch of karma before letting them downvote. I agree that topic drift happens, witness all of the bitcoin related discussion over the past year or so.
- zmk_ 12y agoAs an econometrician I cannot believe how many times he said 'magic'. There is something very wrong when you put things in your model 'because, who knows, it might be helpful' (like he did with host names). Variable selection is a very hard problem and using 'magic' is asking for problems. It is so disappointing to see machine learning, statistics, econometrics deal with similar problems and fail to learn from one another.
- mikecb 12y agoThat's exactly the recent criticism of 'big data': engineers and others getting correlations they don't understand from all the data they can collect, and attempting to use them for who knows what.
- BWStearns 12y agoTo be fair he did explain that he thought that the host name might be indicative of whether or not it would be druck. If he knew exactly how that was the case (and if it was already known that it did have effect), why bother with machine learning? Just write an explicit scoring mechanism.
- zmk_ 12y agoIt did seem to me that this was an interpretation that he came up with after he tired many different pipelines and "flipped all the switches". There are many sources of randomness that warrant using statistical methods. But it feels strange to me to see people use these tools without giving much thought to parameter stability, parameter significance, causality, model selection in general.
- asdfologist 12y agoIt's a completely harmless toy project, so who cares if he chose his variables non-scientifically? He's not creating a cancer diagnosis tool here.
- zmk_ 12y agoI understand this is a toy project, but he is put in a position in which he educates people how to use these methods and gives the wrong impression. The next guy might use this flawed logic while creating a tool for disease prevalence prediction.
- randyrand 12y agoJust because I think it's worth mentioning, I find it ironic that the link to this video got marked as bad using his algorithm =) Saw this at the link he provided.
- vixin 12y agoExcellent first rate presentation. Those giving technical talks might want to take note.