3 ms·

I remember hearing about Scribe last year from a FB Thift lecture and am really excited that they finally got it open sourced. This definitely solves some desi

• mtw 18y ago
  This is just the first part of the equation, I've done news feeds and one of the most difficult thing to do is aggregate similar actions from the network (such as X people from your network changed their profile photo). I've got a working thing but would love to know how they implemented this
  • aschobel 18y ago
    My understanding is that each module (Photos, Notes, etc) has its own feed which gets aggregated to create the main News feed. If each module is responsible for producing its own feed, it seems like this problem isn't too difficult to solve. Couldn't you just cast this as a search engine problem? You create a term vector with your social graph, and the corpus you are "searching" is people who updated their profile photo in the last 24 hours. You could compute the inverted index offline once an hour. http://en.wikipedia.org/wiki/Inverted_index http://en.wikipedia.org/wiki/Inverted_index