Please release a separate file without trend information, as not everyone will need it. For the data format: How about a simple CSV file with 3 fields: "domain-

Please release a separate file without trend information, as not everyone will need it. For the data format: How about a simple CSV file with 3 fields: "domain-part,path,url". This would translate to such entries: amazon,a, http://www.amazon.com/Geek-Atlas-Places-Science-Technology/dp/0596523203 http://www.amazon.com/Geek-Atlas-Places-Science-Technology/d... If you compress the file (or start a new file every week/month) this shouldn't be much of a burden for your server.