3 ms·
Answer ignores a very public and growing corpus of data: IRC channels.
by r00fus 16y ago
Answer ignores a very public and growing corpus of data: IRC channels.
- enjo 16y agoThe author makes a great point, however, about the ability to link those two together. I'm sure you'd end up with a lot of false positives from IRC as even if it's attributed (ircuser: TWSS!) the flow of IRC conversations is such that it's not always the last thing ircuser said that is being replied to (because of network lag and just general reply lag in IRC). Although now that I think about it... twitter probably often suffers from the exact same issue, although somewhat mitigated as people often include the original tweet in their reply.
- DasIch 16y agoUnless I'm missing something, this only occurs if someone sends two messages to someone and the receiving user responds to the first message but gets the second message before sending his. Using average read/write times for a message - taking its length into account - it should be fairly easy to check if someone could have read and written a response to a message. Assuming it is a response if he could have written one in time should be fairly accurate. You could probably even cheat and use a constant time while still getting good results.
- follower 16y agoI initially thought that myself but this is covered in end note [4]: "[4] I think I once heard of an MSN chat transcript dataset that was really awesome, but I can't seem to find mention of it anymore. Let me know if you know where I can find that or any other instant message datasets. I know that some IRC rooms get publicly logged — is there a single place where one could grab all of them at once?"
- r00fus 16y agoI wouldn't assume just grab an existing log, wouldn't it be just like twitter? (ie, just "follow" a bunch of conversations/channels and build your own corpus by "tapping into the firehose"). You could use pre or post filtering to weed out connect/disconnect and other noise. I only thought of this because there was like two "TWSS" replies in the past couple of days on #rubyonrails
- DasIch 16y agoYou could write a simple client that just ignores connect/disconnect messages from the server. Reading this post I remembered a small project called sociograph a friend of mine created. It's an IRC bot that logs messages and draws a graph of the people communicating with each other in realtime, see for an example http://www.youtube.com/watch?v=A_ah-SE-cNY http://www.youtube.com/watch?v=A_ah-SE-cNY.