2 ms·
This. I write crawler software (adapters mostly) for the same client, and I could never figure out anneasy way for my client to specify the xpath/case paths in
by Ayesh 8y ago
This. I write crawler software (adapters mostly) for the same client, and I could never figure out anneasy way for my client to specify the xpath/case paths in a meaningful way and extract the data.
Every crawler task requires different paging methods, different xpath patterns, etc that it makes things more complicated to generalize it.