5 ms·

Are you crawling them? if so, what package are you using to do it?

• taxonomyman 15y ago
  Yes, crawling. Home brew. Stuff out there is either too complex, or too simple. To be fair, we like to build on our own - probably not a good thing sometimes..
  • AndyNemmity 15y ago
    What language at least? Just curious, I do crawling myself and I'm always fascinated at the design decisions others choose.
    • taxonomyman 15y ago
      CURL with PHP mostly on this project.. How about yourself?
    • aonic 15y ago
      Tell us about your crawler :)