3 ms·
That's an interesting take. I've been experimenting with reducing the overall rendered html size to just structure and content and using the LLM to extract cont
by geuis 2y ago
That's an interesting take. I've been experimenting with reducing the overall rendered html size to just structure and content and using the LLM to extract content from that. It works quite well. But I think your approach might be more efficient and faster.
- nodoodles 2y agoOne fun mechanism I've been using for reducing html size is diffing (with some leniency) pages from same domain to exclude common parts (ie headers/footers). That preprocessing can be useful for any parsing mechanism..