4 ms·
Show HN: Metaheads, a search engine for Facebook comments in the US
- ibdf 5y agoThis is pretty neat. I would include an option to search a date range, or at a minimum display the date of the post and let me sort by date - this would make it easier to find posts that are related to events.
- jawerty 5y agoThank you. The date on each is a priority for new features
- Freak_NL 5y agoI don't think it really works. A search for 'Amsterdam' returns only one comment.
- istinetz 5y ago0 hits for Rammstein and Romania. Perhaps OP just scraped something like a 1000 comments? Also, location filters seem to be hardcoded for US and Canada.
- jawerty 5y agoIt only works for the Us
- hansel_der 5y agoi feel like this should be in the title in order for the rest of humanity to quickly skip it. like an date tag "oh this is from 2010, nevermind". then again, paywalled sites grml
- jawerty 5y agoThanks for the feedback just added
- DarkContinent 5y agoI wasn't able to find comments behind privacy settings--can you add a login extension to make that possible?
- jawerty 5y agoInteresting, yes I can do that
- honkdaddy 5y agoWhere are you getting the comments from? It seems to be a very, very tiny subset.
- jawerty 5y agoIt’s coming from public pages in US cities.
- breakfastduck 5y agoYeah this just doesn't get anything for most terms I've searched where you'd expect thousands if not millions of results. What exactly IS this searching?
- encodedstephen 5y ago“Computer vision” doesn’t seem to bring back any relevant comments.
- jayolden 5y agoThis doesn't work for local languages or country-specific comments, which destroys the purpose of having a search engine for FB comments.
- Karawebnetwork 5y agoThis needs to take spaces and sentences into account. For example, "hacker news" will find results about regular news and no comments have the word "hacker" in them.
- jawerty 5y agoHi, Just to clarify a few things. This search only works for cities in the US.
- doubleorseven 5y agoso if i'm not from or don't care about US pages, can you at least share some info about what you do there? I'm guessing GQL but I'm just guessing.
- jawerty 5y agoAbsolutely, I algorithmically fetch prominent public news/media pages from a list of us cities of at least a few thousand and get the comments from each page.
- Leary 5y agoGreat project! One thing I'm sure a lot of people would find useful is a "top comments" page that shows what the most popular/ trending topics are. Or is it possible to find what sort of news articles are the most popular? I often hear both side of the political spectrum saying Facebook is biased. Would be cool to see if it was true.
- jawerty 5y agoThanks for the note. Funny enough I’m working on some sentiment analysis in another project on bias. parallel thinking
- matt123456789 5y agoWow, super responsive. Great work. I don’t want to ask how you scraped these, but can you talk about your software (solr?) and compute resources?
- jawerty 5y agoMongodb aggregation pipeline working wonders.
- altdataseller 5y agoThis is Facebook posts posted on FB pages from external ppl, not comments on other page posts. Misleading title.