5 ms·

Thanks! That's very interesting in itself, and there's way more going on than I first realised. Apologies if I missed it, but what's your general strategy for

Thanks! That's very interesting in itself, and there's way more going on than I first realised. Apologies if I missed it, but what's your general strategy for crawling? Is the list of sources curated or are you looking across the whole internet for content?

garysieling 10y ago
I'm curating a list of sources - that makes the dataset easier to deal with, and I think higher quality. In a lot of cases I'm trying to rely on someone else having vetted speakers. E.g. a conference picking speakers, universities hiring good professors, someone recommending a talk on hacker news. I also boost the ranking if a speaker is interesting enough to have a wikipedia page.
- midgetjones 10y ago
  Interesting. Thank you!