2 ms·
feeding an entire DOM tree into an LLM and waiting for the response sounds like a terrible thing to include in a latency-sensitive render pipeline.
by skulk 2y ago
feeding an entire DOM tree into an LLM and waiting for the response sounds like a terrible thing to include in a latency-sensitive render pipeline.
- gmerc 2y agolonger than loading dozens of shit js, tracking pixels and obfuscation code into the renderer? The moment I can use a cheap edge LLM to reduce the entire page to the few bullet points I care about with optional expansion of content I don’t really care much anymore about render timing - the ultimate cost on us is extraction the information we want from the page, which is getting more and more enshittified because our attention is being sold.
- gmerc 2y agoLooks like apple thinks so too https://www.macrumors.com/2024/04/30/safari-ai-features-coming-in-ios-18/ https://www.macrumors.com/2024/04/30/safari-ai-features-comi...