2 ms·
Since OP is dead: jwblackwell 48 minutes ago | link [dead] We built a search engine that shows you the most engaging stories/topics being shared across Twitte
by Kiro 13y ago
Since OP is dead:
jwblackwell 48 minutes ago | link [dead]
We built a search engine that shows you the most engaging stories/topics being shared across Twitter, Facebook, Linkedin, and Google+. We crawled over 15 million articles the past 3 months, retrieved the total number of Facebook likes, tweets, Google+’s etc and built a search index around it.
Here's what our infrastructure looks like:
Rails/Redis: We use the Sidekiq gem as a message queue. We have hundreds of workers that do the crawling, data mining, and number crunching.
ElasticSearch: We built the search index using ElasticSearch, with the data imported from our Postgres database.
AngularJS: Front-end is built using AngularJS and Laravel 4 (PHP), which sends the requests to our Rails server in the backend.
- deleted 13y ago[deleted]
- jackmaney 13y agoI don't get it....why would it be dead? Did the OP delete that post, or was it just heavily downvoted? And if the latter, why?!
- jwblackwell 13y agoIt's way down at the bottom! Obviously no one upvoted :( https://news.ycombinator.com/item?id=6437715 https://news.ycombinator.com/item?id=6437715
- Kiro 13y agoNo, it's killed so no-one can upvote or reply. Not sure why though but maybe you were flagged as a spammer.