2 ms·

Wow! Your HackerID tool is impressive. (I was wondering how I missed that and realized that I was vacationing in LA when you posted that... the very reason I wr

Wow! Your HackerID tool is impressive. (I was wondering how I missed that and realized that I was vacationing in LA when you posted that... the very reason I wrote 'phr0zen news') At the moment, I am just grabbing the front page RSS and posting it like a blog. I would like to do the following too: 1. Deep Search - Index target webpage, comments, weighted by points gained by post/comment itself and submitter/commenter-karma. For example, I was to be able to search and read everything ever said here about EC2. This will be very useful for me personally, so I have good selfish reasons to do this. 2. Relationship between users (as you mentioned) - a graphical representation... what we uncover might be interesting. ( Users that pg replied to will have a 'knighted' symbol next to them ;-) ) I will supply a feed as soon as I figure that out. Is there a way to grab ALL the data from HackerID? BTW, when I read 'name the best hacker news contributers', I thought it is a contest :-)

bootload 19y ago
"... Is there a way to grab ALL the data from HackerID? ..." Yes. I've been saving the individual files since I've run the system as ISO8602 filename ".xml" since it started. I'm going to now write some code to store it in a db beats the 4Mb of text files I have. Also I want to write a quick script to add the archived files to the db. "... Users that pg replied to will have a 'knighted' symbol next to them ;-) ..." Nice touch. What I'm doing is checking if users on the leader board top 30 or top10 or number 1 and adding a star with 10, 30 or 1. Im also working on filters for 'pg' meaning he's off the board. I tell you what would be nice is to synchronise the snapshot captures (by ISO-8602 time stamps set to Zulu time ie: 2007-09-30T00:16:42Z or now). This means you can at some later time import any data into a db and do a query by time. "... when I read 'name the best hacker news contributers', I thought it is a contest :-) ..." Yeah good point. Might have to change/tweak this it a bit. Maybe add a question mark. My objectives at the moment are to - do deep search on hacker by article in "new/" and extract WHO is making comments and build some sort of heirarchy of user interaction with link to comments - do some stats on the hacker data - " a graphical representation." I'll be using grahpviz ~ http://www.graphviz.org/Gallery.php http://www.graphviz.org/Gallery.php You can see here some initial testing I've done (with static data) ~ http://flickr.com/photos/bootload/1291043939/ http://flickr.com/photos/bootload/1291043939/ On the last one I'm finding a lot of variation b/w karma, comments. points and time. Interesting to see. The real objective is to release this as data rather than just pages so users can use the data (not sure about RT) to look at things on a particular day. My objectives are different from yours keep up the good work and plz try to make the data free for use by others to use.

bootload 19y ago

"... Is there a way to grab ALL the data from HackerID? ..." Yes. I've been saving the individual files since I've run the system as ISO8602 filename ".xml" since it started. I'm going to now write some code to store it in a db beats the 4Mb of text files I have. Also I want to write a quick script to add the archived files to the db. "... Users that pg replied to will have a 'knighted' symbol next to them ;-) ..." Nice touch. What I'm doing is checking if users on the leader board top 30 or top10 or number 1 and adding a star with 10, 30 or 1. Im also working on filters for 'pg' meaning he's off the board. I tell you what would be nice is to synchronise the snapshot captures (by ISO-8602 time stamps set to Zulu time ie: 2007-09-30T00:16:42Z or now). This means you can at some later time import any data into a db and do a query by time. "... when I read 'name the best hacker news contributers', I thought it is a contest :-) ..." Yeah good point. Might have to change/tweak this it a bit. Maybe add a question mark. My objectives at the moment are to - do deep search on hacker by article in "new/" and extract WHO is making comments and build some sort of heirarchy of user interaction with link to comments - do some stats on the hacker data - " a graphical representation." I'll be using grahpviz ~ http://www.graphviz.org/Gallery.php http://www.graphviz.org/Gallery.php You can see here some initial testing I've done (with static data) ~ http://flickr.com/photos/bootload/1291043939/ http://flickr.com/photos/bootload/1291043939/ On the last one I'm finding a lot of variation b/w karma, comments. points and time. Interesting to see. The real objective is to release this as data rather than just pages so users can use the data (not sure about RT) to look at things on a particular day. My objectives are different from yours keep up the good work and plz try to make the data free for use by others to use.