3 ms·
Karpathy constantly shows the gap between "Anyone could've done that" and "Yeah, but he _did_."
by slashcom 12y ago
Karpathy constantly shows the gap between "Anyone could've done that" and "Yeah, but he _did_."
- nl 12y agoIt's only in the last 12 months that it became clear this was possible. The Ng "Zero Shot Learning" paper came out at NIPS2013, and given the lead time for a paper like that I think they must have started work at about that time.
- nl 12y agoWow, those downvotes are pretty strong! Clearly I'm wrong - what am I missing?
- mlla 12y agoThis is done using Latent Dirichlet Allocation (LDA). The original algorithm was published by David Blei et al over ten years ago, link to the paper: http://machinelearning.wustl.edu/mlpapers/paper_files/BleiNJ03.pdf http://machinelearning.wustl.edu/mlpapers/paper_files/BleiNJ... There are many machine learning libraries that have good implementations of LDA (e.g. Gensim), so it should be "relatively" straightforward to create the topics and clustering based on the abstracts of the papers.
- jamessb 12y agoI think there might be confusion about wht nl was referring to. Yes, the link is to a list (produced by Karpathy) of papers on which LDA has been performed. But one of the listed papers is also by Kapathy ("Deep Fragment Embeddings for Bidirectional Image Sentence Mapping"), and I think this might be what nl is complimenting as being done quickly.
- nl 12y agoYes this is the case. Thanks