3 ms·
Been thinking about this many times. I regularly check what HM things about a specific book, what services HN recommends to perform a particular task, etc.. To
by leobg 4y ago
Been thinking about this many times. I regularly check what HM things about a specific book, what services HN recommends to perform a particular task, etc..
To the sibling comment that I asked about doing this locally: there’s really no need for an LLM, much less for GPT-3. All you need is, well, attention. Sentence-transformer embeddings. Perhaps even just fastText.
- rahimnathwani 4y agoAIUI sentence-transformer embeddings work for sentences or short paragraphs. But many comments only make sense in the context of parent/GP comments. This is especially true when a comment answers an earlier question. I'm not sure how we'd pack enough context into a single 'sentence', to get a useful embedding for this purpose. (I might be wrong of course.)
- leobg 4y agoYou keep track of the topic by prepending a summary of the parent. The hierarchical nature of HN should make this somewhat easy.