3 ms·
Oh geez. Webcrawler, and robots.txt. There was no SEO, just "don't overwhelm my modem / ISDN connection / T1". It's been a while!
by insulanus 8y ago
Oh geez. Webcrawler, and robots.txt. There was no SEO, just "don't overwhelm my modem / ISDN connection / T1". It's been a while!
- abritinthebay 8y agoA lot more interesting protocols too! I miss gopher & finger