Working on a web-reader tool of the kinda you might hook into an LLM as a MCP. Wanted to see how far I can get on my own rather than using something commercial.

Working on a web-reader tool of the kinda you might hook into an LLM as a MCP. Wanted to see how far I can get on my own rather than using something commercial. Surprised how difficult it is to get anything usable. The web really has turned hostile - anything not on a residential IP gets blocked by like 50% of the sites no questions asked I guess they're all responding to mass scraping