4 ms·
It's possible that the feed reader attaches it itself based on when it appears in the feed since the reader will keep polling the same feed over time
by Minor49er 4y ago
It's possible that the feed reader attaches it itself based on when it appears in the feed since the reader will keep polling the same feed over time
- pipeline_peak 4y agoI’m not understanding your suggestion. It’s using Microsoft Syndication Feed to parse the RSS files which themselves are missing pubdate info. There’s nothing stored on disk. Feed I'm parsing http://rss.cnn.com/rss/cnn_topstories.rss http://rss.cnn.com/rss/cnn_topstories.rss
- 6510 4y agoIn this case most items have <pubDate>'s, for the ones without you use the feeds <pubDate> in the <channel>
- pipeline_peak 4y agoUsing the same channel pubdate for all the items with missing ones wouldn't be accurate. I'm using The Old Reader as an example and all of their missing items have different dates.
- 6510 4y agojust dates or date and time?
- pipeline_peak 4y agodate and time
- 6510 4y agoThey are probably polling the feed.
- pipeline_peak 4y agoWhat do you mean by this, they are listening for changes in the webpage?
- 6510 4y agoThey check the feed every x min, if a new item appears they use the current time (or the channel pupDate) as the item pubDate. There might be more accurate ways but this is good enough. How is your thing suppose to work? Are you going to load all the feeds for every visitor? Even if it is just for personal use, how many feeds are we talking about? If you pull 20 per second and have only 200 the 10 seconds delay is going to be more annoying than it needs to be. You should probably consider storing the feeds on disk or in a db.
- pipeline_peak 4y agoMy goal is to load all feeds for every visitor, 200 feeds at first but ideally more. Like another person suggested, I will likely use Internet archive to make an api request and retrieve date time. If that’s inaccurate then I will use polling, but that does seem expensive. Are you suggesting storing the actual rss xml file in a database to be reused efficiently?
- Minor49er 4y agoStore the feed item details in a database. That way, you can store the pubdate if one is present, and if not, just use the timestamp for when the item was first detected