4 ms·
That's a really awesome project! Have you written anywhere about the process/challenges?
by midgetjones 10y ago
That's a really awesome project! Have you written anywhere about the process/challenges?
- garysieling 10y agoI started writing up an outline / notes for a talk, which you can see here- https://www.findlectures.com/articles/2017/01/22/Software-Architecture-of-FindLectures-com/ https://www.findlectures.com/articles/2017/01/22/Software-Ar... I think there is a fair amount of detail there, but if you have questions I'm happy to elaborate :)
- midgetjones 10y agoThanks! That's very interesting in itself, and there's way more going on than I first realised. Apologies if I missed it, but what's your general strategy for crawling? Is the list of sources curated or are you looking across the whole internet for content?
- garysieling 10y agoI'm curating a list of sources - that makes the dataset easier to deal with, and I think higher quality. In a lot of cases I'm trying to rely on someone else having vetted speakers. E.g. a conference picking speakers, universities hiring good professors, someone recommending a talk on hacker news. I also boost the ranking if a speaker is interesting enough to have a wikipedia page.
- midgetjones 10y agoInteresting. Thank you!