3 ms·
How is passing a site's homepage to an LLM supposed to make it develop a custom crawler?
by crazygringo 10mo ago
How is passing a site's homepage to an LLM supposed to make it develop a custom crawler?
- wtetzner 10mo agoIt's not, the crawler would use the LLM to read the contents of the first page to dynamically determine the best way to capture the data (e.g. the zip file from TFA).