4 ms·
Hey sorry I didn't see this reply until now! We take the transcripts and run natural language processing models on them to find keywords, n-grams, and pronouns
by prohobo 5y ago
Hey sorry I didn't see this reply until now!
We take the transcripts and run natural language processing models on them to find keywords, n-grams, and pronouns. We then categorize the pronouns according to type (person, organization, media, location, event, etc.)
The search engine itself is just transcripts in Elasticsearch.
From the feedback I've gotten so far, I think the best thing to do is actually integrate this with YouTube through a browser extension, and have users call the backend to do this processing on-demand (with caching of course). It seems the video breakdowns are more important than searching for most people, since with YouTube you can do some kind of content searching, just not very transparently.