3 ms·
At this point, I would actually think nothing would be better. It seems like any attempt to part plain text for structured information or urls would just add n
by protomyth 14y ago
At this point, I would actually think nothing would be better. It seems like any attempt to part plain text for structured information or urls would just add noise to search results. I can seen using it as text for terms but not much else.
- anonymouz 14y agoThe crawler still hits the actual "URL" he found, so that provides sanity checking. It's just another way to discover (potential) new URLs.
- protomyth 14y agoI see your point and the sanity check is good. My problem with the whole thing is that interpreting text is fraught with problems and I just don't see the value from a search perspective. Something served as plain/text either is a problem with the server or just a plain text file. Either way, it seems like a poor value thing to add to a search.