4 ms·
How would something like this work in practice? Would you generate any tags or summaries per site when inserting it into the db?
by SpriglyElixir12 3y ago
How would something like this work in practice? Would you generate any tags or summaries per site when inserting it into the db?
- janalsncm 3y agoYou could run a full text search or search against an auto-generated summary. Or if you want to be fancy, use semantic search like in Retrieval Augmented Generation.
- sudobash1 3y agoArchiveBox can extract text from HTML (and possibly PDFs too). I think it can be configured to extract subtitles from YouTube videos as well. So it can do full text searches. Basically you could have your own, offline & curated search-engine.