3 ms·
For God's sake don't delete it! First of all dump it to files instead of DB. (Or use some NoSQL Document Storage, such as MongoDB. The structure of RSS is actua
by haddr 14y ago
For God's sake don't delete it!
First of all dump it to files instead of DB. (Or use some NoSQL Document Storage, such as MongoDB. The structure of RSS is actually non-relational, I suppose)
Second of all: is your data clean? If not then you might need to clean it from any boilerplate (such as HTML code)
Then you can process it with some tools. There are some good NLP tools available such as Gate. You may have a look at them.
You can do great deal of things there:
- detect some entities (companies? products?) and do some classification of documents
- you can detect some events (iPhone announcements, etc)
- if you have time & date (hope you have) you can do some trending topics analysis (what was hot in June 2010)
- probably you can't sell the data as the content of articles is not yours, but you may sell some derived data (analysis, etc)