Yes, that seems to be the larger challenge. The search tools I have used will work for a while until they don't. Real cat & mouse game. Hence the "adaptive"

Yes, that seems to be the larger challenge. The search tools I have used will work for a while until they don't. Real cat & mouse game. Hence the "adaptive" part of my comment. It really needs to be a client side agent.