5 ms·
Responding to jacquesm's challenge
- ErrantX 17y agoGreat to see an analytical approach to the challenge :D Although reviewing your first list most of them actually seem unlikely (for a variety of reasons).
- jgrahamc 17y agoI'm dying to know if this turns out to be right, or not. I actually have a totally different list which is based on a different handling of punctuation. It suggests that the most likely person who also commented on that thread is zaveri.
- ErrantX 17y agoIm still convinced the lower case use of google, facebook etc. (which occured more than once in the comment) is important - especially as there is one Google at the start of a sentence - indicating it is intentional/common. That's why I personally discounted many from your first list (plus the fact I know a few are native English speakers)
- stcredzero 17y agoI am aghast that people would think I'm not a native English speaker. I hope I'm numbered in the "few." Disclaimer: sometimes Windows handwriting recognition makes a real hash of my post without my noticing.
- jjs 17y agoRun it through a Markovian classifier like CRM114 (or, if that's too expensive, just do it for the likely candidates identified by your naive Bayesian classifier).
- jacquesm 17y agoHey hey, two guesses each :) Now I have to add my third from the list: nostrademons.
- brown9-2 17y agoThis challenge is a bit flawed in that we have no way of knowing if the anonymous poster is willing to ever confirm that he/she made the post, isn't it? Not to state the obvious but it just seems that even if a great amount of technical work is put into this, you'll never know the answer unless the person in question agrees to participate.
- eru 17y agoYou can test your techniques on comments (not used in training) for which you know the author. If you can achieve a high accuracy there, you can be fairly sure to be correct in the challenge, too.
- stcredzero 17y agoWell, for one thing, I much prefer telling jacquesm he's wrong as myself! :)
- wynand 17y agoWhat did you use to compute P(D|Ci)? This uses your notation from the Dr Dobbs article, so that Ci (a category) is a user and D is a document (a comment?). Did you use something like trigram signatures? Also, is P(Ci) equal to #comments made by Ci/total number of users? Interesting stuff jgrahamc!
- jgrahamc 17y agoI just used whitespace separated words after stripping punctuation.
- jfarmer 17y agoIn authorship identification punctuation can be very important, as can non-grammatical features like the distribution of the number of syllables per word.
- pbhjpbhj 17y agoI'd have thought that capitalisation and punctuation were key elements in any textual analysis. In the subject text there is a very unusual hyphenation "pure-ad" for example.
- davidw 17y agoDid you look at posting times at all to exclude people who never post at certain times? (I should add that that's not my idea but something someone posted on the original thread).
- swombat 17y agoHahaha, you still haven't found me out. Oh wait..
- jacquesm 17y agoThanks, that at least puts the heat off my name popping up again. Maybe we subconsciously adopt the style of the person we reply to :) ?
- Quarrelsome 17y agoWe do. It's called neuro linguistic programming or the "familiarity principle". Sales people use this for effect.
- Splines 17y agoSeeing people do this in real time must be interesting. Seeing it work must be astonishing.
- Quarrelsome 17y agoI used to do cold call sales for a living and from the "pick up" you can tell what kind of person is answering and modify your voice accordingly. You basically just follow their lead. E.G: * Quiet people don't want shouty salesmen so go quiet, reserved and professional. * Some guy off a council estate/trailer park is typically not going to want to talk to a suit so in that case you'll adopt a very casual and matey tone as if you've bumped into him in a pub/bar. * If I EVER met someone who "knew the score" (e.g. someone smart or knows how telesales work) then I'd just drop all pretences and give it to them "straight". Those are the "obvious" kinds of NLP, there are subtle bits and pieces including copying their tone or turns of phrase. It does increase your conversion rate. Obviously (almost) everyone HATES cold calls so one of my goals was to see how long I could keep "angrys" on the phone. NLP definitely helps here (although empathy, humility and diplomacy are probably more useful) I even managed to sell to one once! :D
- DanielBMarkham 17y agoSo basically everybody struck out. Most likely due to sample size. There's an interesting lesson here that probably says something like the coolness of the tool used has no direct relation to the usefulness of the conclusions provided.
- stse 17y agoI think it would be more interesting if the "guesses" would actually take into consideration how successful or unsuccessful the method is with the data available. For example, how likely are each of the names he mentioned and how likely is it that it's any one of them? Edit: If someone here has a background in intelligence I would love to here their take on the challange.
- caffeine 17y agoSadly, most of the statistics community continues to ignore your pithy lesson, to the great distress of all involved.
- sgoranson 17y agoVery cool, and appropriate that you're basically using PG's spam filtering to identify users on his site :) I think the next step is to write a more complex filter that does not assume word probabilities are independent of each other, i.e. take unusual phrases like "entirely dissimilar" into account.
- dangoldin 17y agoIsn't the Naive Bayes classifier biased to users with a large volume of text? Ie if there are two users and one writes 99% of the content it's very likely that that user will be picked as the author for almost anything? At the same time, this may be desired since someone who does contribute a lot on HN may have also desired to have some fun.
- jgrahamc 17y agoThe key calculation is given a word w what's the frequency with which this user uses word w. So that's number of times w occurs / numbers of words that user has used. So it doesn't matter as long as a user has 'enough' text so that they've covered a good portion of the overall dictionary of words in use. The prior probability is based on the number of comments a user makes. In this case that prior is insignificant because the sample text is large.
- eru 17y agoTraining on word pairs or triples may also be worth a look, instead of going for single words only.
- gcheong 17y agoDidn't somebody code up a website a while ago that looked for other HN members that were similar in commenting style to oneself?
- adrianwaj 17y agoWould the owner of the comment just fess up for pete's sake? We won't hurt you. edit: there's some new text to put through the filter: http://news.ycombinator.com/user?id=onetimetoken http://news.ycombinator.com/user?id=onetimetoken and please try running the previous suspects through the filter: marketer, citizenparker, martythemaniak, eru, vaksel, neilc, vanelsas, swelljoe Also, if it's not you of those, please formally deny it.
- JesseAldridge 17y agoThere's a misspelled word in the profile. http://searchyc.com/identitiy http://searchyc.com/identitiy
- fnid2 17y agoDon't rule out jacquesm himself! It'd be just the kind of thing he would do.
- hooande 17y agoThat's a nice approach, but a naive bayes classifier doesn't seem like it would be the best method for this particular problem. You probably want to do an N-gram analysis, like that performed by libtextcat http://software.wise-guys.nl/libtextcat/ http://software.wise-guys.nl/libtextcat/. This will perform a comparison based on common combinations of letters used (like "wo", "or", "rd"). Seems like it would be more accurate with such a relatively small sample of comments. If you had a list of 10-20 possible candidates, you could narrow it down to just a few.
- jxcole 17y agoThis is certainly an interesting problem,but without having some access to the data I don't think I could really approach it. Perhaps I am alone in saying this, but I think data mining is interesting while web crawling is boring. Could somebody make the data available so that we don't have to write a crawler? Or is this part of the challenge? I think this is a classic example of unsupervised learning, for which I would generally use a system like Fuzzy ART. I think that might perform better than a naive Basyesian text classifier though I can't be sure until I try it out.
- jdrock 17y agoIf anyone wants to use 80legs for this challenge, just drop us a line at http://www.80legs.com/contact.html http://www.80legs.com/contact.html. We might be able to set up some custom free plans.
- JesseAldridge 17y agohttp://dl.dropbox.com/u/135901/rare_words.py http://dl.dropbox.com/u/135901/rare_words.py
- anigbrowl 17y agoThis is my inscrutable face.
- petercooper 17y agoAs I was in the list on there, I just want to confirm it wasn't me but when I read the original comments left by the anonymous commenter, I saw a lot of my own syntax mannerisms - at least the algorithm isn't too bad, eh? ;-)