2 ms·
This is brilliant, how did you do it, scraping or via an API? I'd love to do something similar for different subject areas.
by mistermann 9y ago
This is brilliant, how did you do it, scraping or via an API? I'd love to do something similar for different subject areas.
- garysieling 9y agoA mix of scraping and APIs - e.g. http://confreaks.tv/ http://confreaks.tv/ has a great API where you can get the whole dataset in a json file
- mistermann 9y agoJust to make sure I'm understanding you, you're using the API's here: http://confreaks.tv/api/v1 http://confreaks.tv/api/v1 ....but as an example though, I can't find any speakers named Lomax in: http://confreaks.tv/api/v1/presenters.json http://confreaks.tv/api/v1/presenters.json Or the Category designation, it doesn't exist in the API above but for a few videos I looked at I didn't see any comparable metadata on YouTube either....is some of it manually added in your curation, or are you doing something magical with "Portions of text Analysis by AlchemyAPI"? I imagine you know about this already (haven't tried it but potentially useful): https://support.google.com/youtube/answer/6084053?hl=en https://support.google.com/youtube/answer/6084053?hl=en
- garysieling 9y agoThat particular speaker came from the Library of Congress, which I wrote a scraper for. The first level of categories come from either Youtube or the AlchemyAPI, depending on the talk. Levels 2+ are from AlchemyAPI or the scrape. The taxonomy they use is for advertising, and Youtube's categories match up with level 1 of that taxonomy. The taxonomy lacks detail for programming topics so I wrote a script to tag things that mention programming languages.
- mistermann 9y agoGreat thank you. If the code isn't confidential I'd love to take a look, but understand if it isn't.