Hi @ethanwillis, thanks a lot for the feedback! I'm actually trying to look at expanding the crawler code to provision spiders and pass along a configuration w

Hi @ethanwillis, thanks a lot for the feedback! I'm actually trying to look at expanding the crawler code to provision spiders and pass along a configuration when creating it. Probably through CLI arguments or a .conf file, still undecided yet, and move on from there. Thanks a lot for the view suggestions, will definitely look at this when having a stab at this aspect :)