3 ms·
It uses GPT to extract the data: https://github.com/fetchfox/fetchfox/blob/public/src/lib/scrape.mjs https://github.com/fetchfox/fetchfox/blob/public/src/lib/sc
by marcell 2y ago
It uses GPT to extract the data: https://github.com/fetchfox/fetchfox/blob/public/src/lib/scrape.mjs https://github.com/fetchfox/fetchfox/blob/public/src/lib/scr...
I haven't put together a good test framework yet, but qualitatively, the results are surprisingly good, and hallucinations are fairly low. The prompt tells GPT to say (not available) if needed, which helps.
I'm going to try the "generate selectors" approach as well. If you'd like to learn more or discuss just reach out via email (marcell.ortutay@gmail.com) or discord (https://discord.gg/mM54bwdu59 https://discord.gg/mM54bwdu59 @ortutay)