3 ms·
Thanks! 1) Many of the projects I do usually have some sort of crawling aspect to it. So therefore I found myself duplicating crawling code every time and so I
by Axsuul 11y ago
Thanks!
1) Many of the projects I do usually have some sort of crawling aspect to it. So therefore I found myself duplicating crawling code every time and so I decided to turn it into a hosted service that all my projects could benefit from. It stores responses, handles proxyification, and has all sorts of optimizations implemented that's useful and essential to crawling. It passes data via evented webhooks and is built in Rails, PostgreSQL, and Redis. As of now, it's not open to the public but if there's interest, that could change :) For more information, please see:
http://bit.ly/1KiUmlS http://bit.ly/1KiUmlS
2) Right now the "trending score" is calculating based on the current and previous Snapshot. The formula is as follows:
current_snapshot_earnings - previous_snapshot_earnings
------------------------------------------------------------------
previous_snapshot_earnings
Very simplified I know :) Your formula is much better and I plan on implementing that soon! Thanks for checking out PledgeSociety as well as the lovely feedback.
- avinassh 11y ago> handles proxyification what is proxyification?
- markovbling 11y agoWould love to see a blog post on how your hosted service works :)
- NosajHN 11y ago1) Awesome! I've signed up. Hope to hear more. 2) Absolutely, thanks again for making the site. For what it's worth, the same author recently went into much more detail on how to make an optimal 'hot' algorithm, looking at Reddit as an example. I thought it was pretty interesting, even if it's a bit more complicated. http://www.evanmiller.org/deriving-the-reddit-formula.html http://www.evanmiller.org/deriving-the-reddit-formula.html