3 ms·
This sounds pretty awesome. Would you mind posting some of the code? I'd be curious to know how you're formatting the input data. If you're just using the titl
by thomaspaine 17y ago
This sounds pretty awesome. Would you mind posting some of the code?
I'd be curious to know how you're formatting the input data. If you're just using the title, all of the text parsed through BeautifulSoup, some parsing algorithm to obtain the body of the article, etc.
Not too long ago, I wrote a python script to automatically extract the bodies of articles, which you may find useful: http://blog.davidziegler.net/post/122176962/a-python-script-to-automatically-extract-excerpts-from http://blog.davidziegler.net/post/122176962/a-python-script-...
- sqs 17y agoThanks. I'll definitely post the code soon. I'm using the title, the submitter's name, the URL, and the page content without tags (only looking at <p> and similar tags would probably help). Including the content of the HN comments pages might help, too. Thanks for the link; I'll check it out.
- sqs 17y agoOK, the source is here: http://hackerhackernews.com/hhn-20090706.tgz http://hackerhackernews.com/hhn-20090706.tgz
- deleted 17y ago[deleted]