4 ms·

I got so frustrated with youtube discovery that I built my own search, although only for talks - https://www.findlectures.com/ https://www.findlectures.com/

dalbasal 9y ago
Cheers. I love these replies on hn. Me: bitch, bitch, complain. You: here I fixed that. :)
- vanderZwan 9y ago
  There should be some kind of Cunningham's Law-variant for that phenomenon
mistermann 9y ago
This is brilliant, how did you do it, scraping or via an API? I'd love to do something similar for different subject areas.
- garysieling 9y ago
  A mix of scraping and APIs - e.g. http://confreaks.tv/ http://confreaks.tv/ has a great API where you can get the whole dataset in a json file
  - mistermann 9y ago
    Just to make sure I'm understanding you, you're using the API's here: http://confreaks.tv/api/v1 http://confreaks.tv/api/v1 ....but as an example though, I can't find any speakers named Lomax in: http://confreaks.tv/api/v1/presenters.json http://confreaks.tv/api/v1/presenters.json Or the Category designation, it doesn't exist in the API above but for a few videos I looked at I didn't see any comparable metadata on YouTube either....is some of it manually added in your curation, or are you doing something magical with "Portions of text Analysis by AlchemyAPI"? I imagine you know about this already (haven't tried it but potentially useful): https://support.google.com/youtube/answer/6084053?hl=en https://support.google.com/youtube/answer/6084053?hl=en
    - garysieling 9y ago
      That particular speaker came from the Library of Congress, which I wrote a scraper for. The first level of categories come from either Youtube or the AlchemyAPI, depending on the talk. Levels 2+ are from AlchemyAPI or the scrape. The taxonomy they use is for advertising, and Youtube's categories match up with level 1 of that taxonomy. The taxonomy lacks detail for programming topics so I wrote a script to tag things that mention programming languages.
      - mistermann 9y ago
        Great thank you. If the code isn't confidential I'd love to take a look, but understand if it isn't.

dalbasal 9y ago

Cheers. I love these replies on hn. Me: bitch, bitch, complain. You: here I fixed that. :)

vanderZwan 9y ago
There should be some kind of Cunningham's Law-variant for that phenomenon

mistermann 9y ago

This is brilliant, how did you do it, scraping or via an API? I'd love to do something similar for different subject areas.

garysieling 9y ago
A mix of scraping and APIs - e.g. http://confreaks.tv/ http://confreaks.tv/ has a great API where you can get the whole dataset in a json file
- mistermann 9y ago
  Just to make sure I'm understanding you, you're using the API's here: http://confreaks.tv/api/v1 http://confreaks.tv/api/v1 ....but as an example though, I can't find any speakers named Lomax in: http://confreaks.tv/api/v1/presenters.json http://confreaks.tv/api/v1/presenters.json Or the Category designation, it doesn't exist in the API above but for a few videos I looked at I didn't see any comparable metadata on YouTube either....is some of it manually added in your curation, or are you doing something magical with "Portions of text Analysis by AlchemyAPI"? I imagine you know about this already (haven't tried it but potentially useful): https://support.google.com/youtube/answer/6084053?hl=en https://support.google.com/youtube/answer/6084053?hl=en
  - garysieling 9y ago
    That particular speaker came from the Library of Congress, which I wrote a scraper for. The first level of categories come from either Youtube or the AlchemyAPI, depending on the talk. Levels 2+ are from AlchemyAPI or the scrape. The taxonomy they use is for advertising, and Youtube's categories match up with level 1 of that taxonomy. The taxonomy lacks detail for programming topics so I wrote a script to tag things that mention programming languages.
    - mistermann 9y ago
      Great thank you. If the code isn't confidential I'd love to take a look, but understand if it isn't.