3 ms·
Unfortunately, I think that's what I'm going to have to do.
by pipeline_peak 4y ago
Unfortunately, I think that's what I'm going to have to do.
- 6510 4y agono no, this is the fun of building the rss/atom reader! My funniest moment was when I didn't notice someone deleted their feed and the missing page redirected to the front page. The many layers of failbacks just parsed the html as if it was a feed. It didn't have <item>s so it tried to parse it without items, it didn't have <link>s or <guide>s so it ended up looking for <a>'s in the <description> but it didn't have <description> so it just accepted any <a>'s and used whatever was in the <a>'s as the <title>.
- pipeline_peak 4y agoI still think it will be fun in an inconsistent, man made jungle of the web sort of way. And I agree the types of mishaps are really interesting because they almost can't be replicated since they depend on so many environmental factors they almost appear physical. There's an interview somewhere on Youtube of Bjarne Stroustroup, I think it was one of those Big Think videos. He was asked what he thought about AI and Machine learning, his response being that he's not interested in things that aren't sound. That really stuck with me, I don't think web scraping is sound, it's guessing retrieval at broken fragments. I admired The Old Reader for including pictures in it's feed, then I saw a CNN post on there about he new M2 Macbook.....with a picture of a kitchen blender as the headline, missing the 5 or so images in the link of M2 Macbooks.