3 ms·
Web Spiders have been around since ‘94 and the spider terminology for mapping networks is even older so they’d likely get it.
by abritinthebay 8y ago
Web Spiders have been around since ‘94 and the spider terminology for mapping networks is even older so they’d likely get it.
- insulanus 8y agoOh geez. Webcrawler, and robots.txt. There was no SEO, just "don't overwhelm my modem / ISDN connection / T1". It's been a while!
- abritinthebay 8y agoA lot more interesting protocols too! I miss gopher & finger