5 ms·

Now AI agents need what RSS does

85 points by julienreszka 5mo ago

alextillman 5mo ago
What's old is new again. The solution RSS offered was structure for an otherwise unstructured challenge (trying to figure out updates on a site). That value grew exponentially when connected to AI (providing the signals of when do I need to look at this site/podcast again). Smart marketing.
erelong 5mo ago
I kinda don't like RSS because I often want like a whole blog archive downloaded if I add a new feed and it usually has limits how far back of posts it will download (randomly configured by each site) Unless someone has a fix of whatever settings I've been using
- happytoexplain 5mo ago
  Sorry, I don't have a solution. But I use RSS for everything, and I can confidently say: RSS is not designed for your use case.
- conesus 5mo ago
  For the Premium Archive tier, NewsBlur attempts to download a blog's entire backlog to backfill stories, whether it's exposed through paging or RFC 5005. Here's more info about how NewsBlur does it: https://blog.newsblur.com/2022/07/01/premium-archive-subscription/ https://blog.newsblur.com/2022/07/01/premium-archive-subscri...
- phyzix5761 5mo ago
  I use Elfeed for Emacs and it stores the history as you download updates so you can always go back and read an old post.
- jayemar 5mo ago
  I had a similar issue where I wanted to read a newly-followed blog from the beginning instead of the point in time when I started to follow, so I created https://refeed.to/ https://refeed.to/
0gs 5mo ago
i mean, i still read hacker news primarily via RSS in feedly. i kind of never stopped using it, and everybody is much more generous with their feeds nowadays than back in google reader times. bearblog, etc. RSS rules
b3ing 5mo ago
I guess if you want your content all slurped up and served as coming from AI with no backlinks.
- 8organicbits 5mo ago
  Anyone know the best practices for keeping AI crawlers off your RSS feeds? I know robots.txt works for the well-behaved bots. Other tools like interstitial captchas don't as the feed readers break if you send them anything but XML. Putting just the post intro in the feed and linking to the website feels like a safer approach, assume you have bot protections on the website, but that's a poor experience for people who want to read in their feed reader.
  - solid_fuel 5mo ago
    I have some aggressive filters in Caddy that block the worst offenders by CIDR range, and also filter by user agent to remove any honest facebook and amazon bots. Otherwise, maybe strong rate limits by IP? Edit: Longer term, the approach might be - provide a separate RSS feed with full content but gated by a query parameter, then only give that URL to known-good consumers via email verification or patreon subscription, etc. It would suck that people would have to pay more to consume content in their preferred way, but depending on your needs it might be a reasonable compromise.
- liam_buildalink 5mo ago
  [flagged]
phyzix5761 5mo ago
I have almost 40 feeds I subscribe to and they're my primary way of getting information I care about without being exposed to ads or other things I don't want to see.
- frigidwalnut 5mo ago
  What are your favorite feeds?
  - phyzix5761 5mo ago
    These are my top ones: Protesilaos: https://protesilaos.com/codelog.xml https://protesilaos.com/codelog.xml and https://protesilaos.com/commentary.xml https://protesilaos.com/commentary.xml HN: https://hnrss.org/frontpage https://hnrss.org/frontpage Sacha Chua: https://sachachua.com/blog/feed/index.xml https://sachachua.com/blog/feed/index.xml David Revoy: https://www.davidrevoy.com/feed/rss https://www.davidrevoy.com/feed/rss Davep: https://blog.davep.org/feeds/all.atom.xml https://blog.davep.org/feeds/all.atom.xml xkcd: https://xkcd.com/atom.xml https://xkcd.com/atom.xml YouTube - Michelle Khare: https://www.youtube.com/feeds/videos.xml?channel_id=UCGGZ_POGmIWG1pQXTDzQv-g https://www.youtube.com/feeds/videos.xml?channel_id=UCGGZ_PO... YouTube - TmarTn2: https://www.youtube.com/feeds/videos.xml?channel_id=UC36MGPfPwOWafAXauiV4LdA https://www.youtube.com/feeds/videos.xml?channel_id=UC36MGPf...
    - sophiabits 5mo ago
      TIL you can get RSS feeds for YouTube channels. Thanks for this!
      - phyzix5761 5mo ago
        You're welcome. You can also turn any subreddit into a RSS feed: https://arkvis.com/blog/2026-04-16_interesting-finds.html https://arkvis.com/blog/2026-04-16_interesting-finds.html
  - _-_-__-_-_- 5mo ago
h4kunamata 5mo ago
>RSS was declared dead in 2013 Where? Not within the homelab space.
- h4kunamata 5mo ago
  I must add that I self-host FreshRSS to fetch news and GitHub repos updates so I can update my stuff, everything in-house, controlled by me. RSS makes life so much easier, some only provide the bare minimal while others, provide the whole post so I can read everything right there without opening a website. Also, some podcast support it so I have a list of podcast that I list and can go back without having to go from website to website. One place to govern them all, RSS still king.
- 8organicbits 5mo ago
  They probably meant it hyperbolically, but RSS was on a downward slope during that period. The recent uptick is fascinating. https://trends.google.com/explore?q=%2Fm%2F0n5tx&date=all&geo=Worldwide https://trends.google.com/explore?q=%2Fm%2F0n5tx&date=all&ge...
  - PunchyHamster 5mo ago
    No, 2013 was demise of Google Reader, which was at the time very good and very accessible so it was how a lot of people used RSS
  - h4kunamata 5mo ago
    >The recent uptick is fascinating With US techs harvesting people's data, subscription mess, cars that are no longer cars but computers on wheel, and now AI, even folks with bare minimal knowledge are self hosting things. All you need is a second hand dirty cheap Dell SFF computer from eBay, install Proxmox on it and even if it comes with only 8GB, you can still spin up a few Proxmox LXC containers (small like Docker but far better). People are going back to buying physical media, old model of things, wired headphones is all time high. MP3 players are all time high, no phone, no subscription, just music. 90s, early 2000s is so back and is a good thing, people themselves are putting a hard break on technology.
PaulHoule 5mo ago
Re: Rate Limits, see https://rachelbythebay.com/w/2024/05/27/feed/ https://rachelbythebay.com/w/2024/05/27/feed/ but coming from an aggressively anticommercial world view. She collects evidence that real world feed readers don't implement RSS correctly https://rachelbythebay.com/w/2026/02/23/readers/ https://rachelbythebay.com/w/2026/02/23/readers/ Her problems are the problems of a polling-based protocol and really if she does not like the RSS protocol she should stop publishing it and stand up an ActivityPub or PubSubHubBub service instead. A big part of the value of Google Reader and the ecosystem around it was that Google could poll your RSS feed once and everyone could read it... A huge win for the Rachels!
- solid_fuel 5mo ago
  > Her problems are the problems of a polling-based protocol and really if she does not like the RSS protocol she should stop publishing it and stand up an ActivityPub or PubSubHubBub service instead. Bit odd to take potshots at a third party blog on this discussion, why single out Rachel? And more to the point, the dynamics here might be due to RSS being polling-based, but if feed readers implemented the RSS logic correctly it wouldn't matter nearly as much, would it?
  - PaulHoule 5mo ago
    (1) Rachel complains more than most. Most people realize it is easier for you to speed up your server/lower your costs than to expect people to implement RSS "correctly" (2) You can use a cache or be correct, pick one! I think of all the lame cache busting methods that are still in use because it took web browsers more than 15 years to get caching mostly right. (3) If you'd been reading Rachel as opposed to asking why I pointed Rachel out your questions would be answered! (4) Polling based systems come in two speeds: too fast and too slow and it is possible to be both at the same time
    - deleted 5mo ago
      [deleted]
    - oliculipolicula 5mo ago
rvz 5mo ago
You mean scraping instead of reading it? Reddit does not like the sound of that at all and are mulling to remove RSS support due to scrapers [0] [0] https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting_communities_from_scrapers_and_platform/ https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting...
- eli 5mo ago
  Well yeah if they provide open access to content then AI labs wouldn’t have to pay them for bull access.
dchuk 5mo ago
I built a site that's similar in concept to Hacker News, but is entirely fed by RSS feed content, that is then bullet-pointed summarized on the article page: https://engineered.at/ https://engineered.at/ But I also extract topics automatically from the content too with LLMs, to allow for dynamic topic pages that users can separately subscribe to to tune their feeds. Haven't promoted it much, but it's pretty amazing what you can do for a couple bucks a month. And my main thesis with this site is that by locking the content to only rss feeds of known blogs, you dramatically reduce the spam submission risk (basically eliminate it). Doesn't handle the spam comment side of things, but that's a different problem. EDIT: I also open sourced a Rails engine I made to power this site if anyone is interested: https://github.com/dchuk/source_monitor https://github.com/dchuk/source_monitor
- shaunpud 5mo ago
  Your browser is not supported. Please upgrade your browser to continue. Can't even view your site with Firefox
  - dchuk 5mo ago
    That’s…bizarre. Let me take a look EDIT: just checked in firefox, I don't see an issue. can you email me at me@dchuk.com and maybe I can debug with you?
    - Joe_Cool 5mo ago
      I just noticed the same thing. UA being blocked for example: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0 Did mess with it some more: Allowed: Opera/9.80 (Windows NT 6.1; U; zh-tw) Presto/2.7.62 Version/11.01 Opera/9.80 (Windows NT 5.1; U; cs) Presto/2.7.62 Version/11.01 406: Mozilla/5.0 (Windows NT 5.1) Gecko/20100101 Firefox/14.0 Opera/12.0 Mozilla/5.0 (Macintosh; Intel Mac OS X 14; rv:140.0) Gecko/20110101 Firefox/140.0 Maybe just remove it?
      - dchuk 5mo ago
_pdp_ 5mo ago
AI agents don't need RSS. What they need is some representation in text. The XML/RSS markup is completely unnecessary.
- implexa_founder 5mo ago
  [flagged]
hparadiz 5mo ago
Never dropped it https://technex.us/.rss https://technex.us/.rss https://github.com/hparadiz/technexus/blob/release/src/Controllers/RSS.php https://github.com/hparadiz/technexus/blob/release/src/Contr... I would enjoy a JSON based refresh of the format.
- ramgine 5mo ago
  This is why I love HN
themafia 5mo ago
> The same logic will now extend to any written content that agents need to reliably consume. Get your rapacious hands away from my website please. > and actively degrades programmatic access. That's your problem. You choose these tools. If they can't function without ripping everyone else off then why do you persist in using them?
grobibi 5mo ago
I need what rss does. Can someone reccomend a way to create an rss feed from a site that has none?
- senectus1 5mo ago
  freshrss will do that for you. It has a built in web scraper.
daxfohl 5mo ago
Google should bring back Google Reader. But make it only for bots. And then drop it again once it gets popular.
tokenfaucet 5mo ago
[flagged]
sperandeo 5mo ago
we spent a decade killing structured feeds in favor of algorithmic timelines and now we're rebuilding them because the algorithms need structured feeds. the circle of life, but for protocols.
hendler 5mo ago
...And Semantic Web.
analogpixel 5mo ago
I have this idea, that instead of browsing completely random things on the internet pushed by what other people are interested in (or want to promote), create an llm that scans through your backlog of projects YOU want to do, and then search the internet for projects/articles about those things, and then create a feed from that. I'm not sure why I keep reading HN, 99% of the content is uninteresting, probably 99.9% now that every article is about AI. maybe I just like clicking on things.
- acgourley 5mo ago
  This is going to happen, but it's too expensive for your LLM to do the scanning, and instead someone needs to build and maintain the index while allowing other people to subscribe to concepts. The problem is no one has sorted out the embedding space this all lives in.
  - iknowstuff 5mo ago
    https://particle.news/ https://particle.news/
  - DSemba 5mo ago
    I'd argue LLMs are getting cheaper, so it will get more feasible for LLMs to soon act on our behalf, bringing only what we're interested in. Projects like OpenClaw and Hermes already show that this can work whether the source is RSS or simply a website the agent visits. Even Google now envisions this, since they recently announced "information agents" (https://blog.google/products-and-platforms/products/search/search-io-2026/ https://blog.google/products-and-platforms/products/search/s...) that will keep working in the background. They surely have an index they can use, but I wonder whether that's necessary? AI agents like Claude Code suggest it's possible to use simple keyword searches, without maintaining vector indexes - https://www.tigerdata.com/blog/why-cursor-is-about-to-ditch-vector-search-and-you-should-too https://www.tigerdata.com/blog/why-cursor-is-about-to-ditch-... It could be that soon we're gonna get a fully personalized briefing on the topics that we're interested in, or maybe a new kind of feed, replacing social media. I'm actually working on the briefing idea myself: https://briefin.com https://briefin.com
overfits-ai 5mo ago
[flagged]
notnullorvoid 5mo ago
I think now more than ever humans need RSS, so we can curate what enters our information feed as the social media experiment continues to degenerate.
nreece 5mo ago
I wouldn't limit it to RSS. They need any structured data (JSON, XML/RSS, CSV etc.). Systems and agents need to monitor and extract public web content into fresh structured data for their ingestion, intelligence workflows and analysis. * Shameless plug * Our data infrastructure layer for businesses and AI turns continuously updated websites into a stream of structured data. https://newsloth.com https://newsloth.com
amai 5mo ago
The issue with RSS is that it doesn't allow to show ads. That is why the RSS reader was killed by Google. Nowadays AI agents also don't read ads. Let's see how that is going, but the ad industry isn't amused about that.
eugeneonai 5mo ago
Agree on RSS as the right shape — and worth adding the cost angle nobody's quantified here yet. Having an LLM read a 50KB HTML page is ~$0.03 of gpt-4o input. Polling 1000 sources hourly = ~$720/day, almost all of it tokenizing layout chrome the model throws away. RSS-shaped feeds drop that 90%+ because they strip to deltas. The harder blocker is the supply side though — publishers earn pennies per human pageview from ads and ~$0 from agent polls, so unless feeds become licensed paid endpoints, the publisher incentive runs against your "publish an RSS feed for your content" recommendation. Just like that :)
ramaseshanms 5mo ago
Indeed, the simplicity and structure behind RSS perfectly fits agentic AI. Web 4.0 (or Web 5.0) would definitely use a protocol whose principles might be similar to RSS.

85 points by julienreszka 5mo ago

What's old is new again. The solution RSS offered was structure for an otherwise unstructured challenge (trying to figure out updates on a site). That value grew exponentially when connected to AI (providing the signals of when do I need to look at this site/podcast again). Smart marketing.

erelong 5mo ago

I kinda don't like RSS because I often want like a whole blog archive downloaded if I add a new feed and it usually has limits how far back of posts it will download (randomly configured by each site) Unless someone has a fix of whatever settings I've been using

happytoexplain 5mo ago
Sorry, I don't have a solution. But I use RSS for everything, and I can confidently say: RSS is not designed for your use case.
conesus 5mo ago
For the Premium Archive tier, NewsBlur attempts to download a blog's entire backlog to backfill stories, whether it's exposed through paging or RFC 5005. Here's more info about how NewsBlur does it: https://blog.newsblur.com/2022/07/01/premium-archive-subscription/ https://blog.newsblur.com/2022/07/01/premium-archive-subscri...
phyzix5761 5mo ago
I use Elfeed for Emacs and it stores the history as you download updates so you can always go back and read an old post.
jayemar 5mo ago
I had a similar issue where I wanted to read a newly-followed blog from the beginning instead of the point in time when I started to follow, so I created https://refeed.to/ https://refeed.to/

0gs 5mo ago

i mean, i still read hacker news primarily via RSS in feedly. i kind of never stopped using it, and everybody is much more generous with their feeds nowadays than back in google reader times. bearblog, etc. RSS rules

b3ing 5mo ago

I guess if you want your content all slurped up and served as coming from AI with no backlinks.

8organicbits 5mo ago
Anyone know the best practices for keeping AI crawlers off your RSS feeds? I know robots.txt works for the well-behaved bots. Other tools like interstitial captchas don't as the feed readers break if you send them anything but XML. Putting just the post intro in the feed and linking to the website feels like a safer approach, assume you have bot protections on the website, but that's a poor experience for people who want to read in their feed reader.
- solid_fuel 5mo ago
  I have some aggressive filters in Caddy that block the worst offenders by CIDR range, and also filter by user agent to remove any honest facebook and amazon bots. Otherwise, maybe strong rate limits by IP? Edit: Longer term, the approach might be - provide a separate RSS feed with full content but gated by a query parameter, then only give that URL to known-good consumers via email verification or patreon subscription, etc. It would suck that people would have to pay more to consume content in their preferred way, but depending on your needs it might be a reasonable compromise.
liam_buildalink 5mo ago
[flagged]

phyzix5761 5mo ago

I have almost 40 feeds I subscribe to and they're my primary way of getting information I care about without being exposed to ads or other things I don't want to see.

frigidwalnut 5mo ago
What are your favorite feeds?
- phyzix5761 5mo ago
  These are my top ones: Protesilaos: https://protesilaos.com/codelog.xml https://protesilaos.com/codelog.xml and https://protesilaos.com/commentary.xml https://protesilaos.com/commentary.xml HN: https://hnrss.org/frontpage https://hnrss.org/frontpage Sacha Chua: https://sachachua.com/blog/feed/index.xml https://sachachua.com/blog/feed/index.xml David Revoy: https://www.davidrevoy.com/feed/rss https://www.davidrevoy.com/feed/rss Davep: https://blog.davep.org/feeds/all.atom.xml https://blog.davep.org/feeds/all.atom.xml xkcd: https://xkcd.com/atom.xml https://xkcd.com/atom.xml YouTube - Michelle Khare: https://www.youtube.com/feeds/videos.xml?channel_id=UCGGZ_POGmIWG1pQXTDzQv-g https://www.youtube.com/feeds/videos.xml?channel_id=UCGGZ_PO... YouTube - TmarTn2: https://www.youtube.com/feeds/videos.xml?channel_id=UC36MGPfPwOWafAXauiV4LdA https://www.youtube.com/feeds/videos.xml?channel_id=UC36MGPf...
  - sophiabits 5mo ago
    TIL you can get RSS feeds for YouTube channels. Thanks for this!
    - phyzix5761 5mo ago
      You're welcome. You can also turn any subreddit into a RSS feed: https://arkvis.com/blog/2026-04-16_interesting-finds.html https://arkvis.com/blog/2026-04-16_interesting-finds.html
- _-_-__-_-_- 5mo ago

h4kunamata 5mo ago

>RSS was declared dead in 2013 Where? Not within the homelab space.

h4kunamata 5mo ago
I must add that I self-host FreshRSS to fetch news and GitHub repos updates so I can update my stuff, everything in-house, controlled by me. RSS makes life so much easier, some only provide the bare minimal while others, provide the whole post so I can read everything right there without opening a website. Also, some podcast support it so I have a list of podcast that I list and can go back without having to go from website to website. One place to govern them all, RSS still king.
8organicbits 5mo ago
They probably meant it hyperbolically, but RSS was on a downward slope during that period. The recent uptick is fascinating. https://trends.google.com/explore?q=%2Fm%2F0n5tx&date=all&geo=Worldwide https://trends.google.com/explore?q=%2Fm%2F0n5tx&date=all&ge...
- PunchyHamster 5mo ago
  No, 2013 was demise of Google Reader, which was at the time very good and very accessible so it was how a lot of people used RSS
- h4kunamata 5mo ago
  >The recent uptick is fascinating With US techs harvesting people's data, subscription mess, cars that are no longer cars but computers on wheel, and now AI, even folks with bare minimal knowledge are self hosting things. All you need is a second hand dirty cheap Dell SFF computer from eBay, install Proxmox on it and even if it comes with only 8GB, you can still spin up a few Proxmox LXC containers (small like Docker but far better). People are going back to buying physical media, old model of things, wired headphones is all time high. MP3 players are all time high, no phone, no subscription, just music. 90s, early 2000s is so back and is a good thing, people themselves are putting a hard break on technology.

PaulHoule 5mo ago

Re: Rate Limits, see https://rachelbythebay.com/w/2024/05/27/feed/ https://rachelbythebay.com/w/2024/05/27/feed/ but coming from an aggressively anticommercial world view. She collects evidence that real world feed readers don't implement RSS correctly https://rachelbythebay.com/w/2026/02/23/readers/ https://rachelbythebay.com/w/2026/02/23/readers/ Her problems are the problems of a polling-based protocol and really if she does not like the RSS protocol she should stop publishing it and stand up an ActivityPub or PubSubHubBub service instead. A big part of the value of Google Reader and the ecosystem around it was that Google could poll your RSS feed once and everyone could read it... A huge win for the Rachels!

solid_fuel 5mo ago
> Her problems are the problems of a polling-based protocol and really if she does not like the RSS protocol she should stop publishing it and stand up an ActivityPub or PubSubHubBub service instead. Bit odd to take potshots at a third party blog on this discussion, why single out Rachel? And more to the point, the dynamics here might be due to RSS being polling-based, but if feed readers implemented the RSS logic correctly it wouldn't matter nearly as much, would it?
- PaulHoule 5mo ago
  (1) Rachel complains more than most. Most people realize it is easier for you to speed up your server/lower your costs than to expect people to implement RSS "correctly" (2) You can use a cache or be correct, pick one! I think of all the lame cache busting methods that are still in use because it took web browsers more than 15 years to get caching mostly right. (3) If you'd been reading Rachel as opposed to asking why I pointed Rachel out your questions would be answered! (4) Polling based systems come in two speeds: too fast and too slow and it is possible to be both at the same time
  - deleted 5mo ago
    [deleted]
  - oliculipolicula 5mo ago

rvz 5mo ago

You mean scraping instead of reading it? Reddit does not like the sound of that at all and are mulling to remove RSS support due to scrapers [0] [0] https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting_communities_from_scrapers_and_platform/ https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting...

eli 5mo ago
Well yeah if they provide open access to content then AI labs wouldn’t have to pay them for bull access.

dchuk 5mo ago

I built a site that's similar in concept to Hacker News, but is entirely fed by RSS feed content, that is then bullet-pointed summarized on the article page: https://engineered.at/ https://engineered.at/ But I also extract topics automatically from the content too with LLMs, to allow for dynamic topic pages that users can separately subscribe to to tune their feeds. Haven't promoted it much, but it's pretty amazing what you can do for a couple bucks a month. And my main thesis with this site is that by locking the content to only rss feeds of known blogs, you dramatically reduce the spam submission risk (basically eliminate it). Doesn't handle the spam comment side of things, but that's a different problem. EDIT: I also open sourced a Rails engine I made to power this site if anyone is interested: https://github.com/dchuk/source_monitor https://github.com/dchuk/source_monitor

shaunpud 5mo ago
Your browser is not supported. Please upgrade your browser to continue. Can't even view your site with Firefox
- dchuk 5mo ago
  That’s…bizarre. Let me take a look EDIT: just checked in firefox, I don't see an issue. can you email me at me@dchuk.com and maybe I can debug with you?
  - Joe_Cool 5mo ago
    I just noticed the same thing. UA being blocked for example: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:140.0) Gecko/20100101 Firefox/140.0 Did mess with it some more: Allowed: Opera/9.80 (Windows NT 6.1; U; zh-tw) Presto/2.7.62 Version/11.01 Opera/9.80 (Windows NT 5.1; U; cs) Presto/2.7.62 Version/11.01 406: Mozilla/5.0 (Windows NT 5.1) Gecko/20100101 Firefox/14.0 Opera/12.0 Mozilla/5.0 (Macintosh; Intel Mac OS X 14; rv:140.0) Gecko/20110101 Firefox/140.0 Maybe just remove it?
    - dchuk 5mo ago

_pdp_ 5mo ago

AI agents don't need RSS. What they need is some representation in text. The XML/RSS markup is completely unnecessary.

implexa_founder 5mo ago
[flagged]

hparadiz 5mo ago

Never dropped it https://technex.us/.rss https://technex.us/.rss https://github.com/hparadiz/technexus/blob/release/src/Controllers/RSS.php https://github.com/hparadiz/technexus/blob/release/src/Contr... I would enjoy a JSON based refresh of the format.

ramgine 5mo ago
This is why I love HN

themafia 5mo ago

> The same logic will now extend to any written content that agents need to reliably consume. Get your rapacious hands away from my website please. > and actively degrades programmatic access. That's your problem. You choose these tools. If they can't function without ripping everyone else off then why do you persist in using them?

grobibi 5mo ago

I need what rss does. Can someone reccomend a way to create an rss feed from a site that has none?

senectus1 5mo ago
freshrss will do that for you. It has a built in web scraper.

daxfohl 5mo ago

Google should bring back Google Reader. But make it only for bots. And then drop it again once it gets popular.

tokenfaucet 5mo ago

[flagged]

sperandeo 5mo ago

we spent a decade killing structured feeds in favor of algorithmic timelines and now we're rebuilding them because the algorithms need structured feeds. the circle of life, but for protocols.

hendler 5mo ago

...And Semantic Web.

analogpixel 5mo ago

I have this idea, that instead of browsing completely random things on the internet pushed by what other people are interested in (or want to promote), create an llm that scans through your backlog of projects YOU want to do, and then search the internet for projects/articles about those things, and then create a feed from that. I'm not sure why I keep reading HN, 99% of the content is uninteresting, probably 99.9% now that every article is about AI. maybe I just like clicking on things.

acgourley 5mo ago
This is going to happen, but it's too expensive for your LLM to do the scanning, and instead someone needs to build and maintain the index while allowing other people to subscribe to concepts. The problem is no one has sorted out the embedding space this all lives in.
- iknowstuff 5mo ago
  https://particle.news/ https://particle.news/
- DSemba 5mo ago
  I'd argue LLMs are getting cheaper, so it will get more feasible for LLMs to soon act on our behalf, bringing only what we're interested in. Projects like OpenClaw and Hermes already show that this can work whether the source is RSS or simply a website the agent visits. Even Google now envisions this, since they recently announced "information agents" (https://blog.google/products-and-platforms/products/search/search-io-2026/ https://blog.google/products-and-platforms/products/search/s...) that will keep working in the background. They surely have an index they can use, but I wonder whether that's necessary? AI agents like Claude Code suggest it's possible to use simple keyword searches, without maintaining vector indexes - https://www.tigerdata.com/blog/why-cursor-is-about-to-ditch-vector-search-and-you-should-too https://www.tigerdata.com/blog/why-cursor-is-about-to-ditch-... It could be that soon we're gonna get a fully personalized briefing on the topics that we're interested in, or maybe a new kind of feed, replacing social media. I'm actually working on the briefing idea myself: https://briefin.com https://briefin.com

overfits-ai 5mo ago

[flagged]

notnullorvoid 5mo ago

I think now more than ever humans need RSS, so we can curate what enters our information feed as the social media experiment continues to degenerate.

nreece 5mo ago

I wouldn't limit it to RSS. They need any structured data (JSON, XML/RSS, CSV etc.). Systems and agents need to monitor and extract public web content into fresh structured data for their ingestion, intelligence workflows and analysis. * Shameless plug * Our data infrastructure layer for businesses and AI turns continuously updated websites into a stream of structured data. https://newsloth.com https://newsloth.com

amai 5mo ago

The issue with RSS is that it doesn't allow to show ads. That is why the RSS reader was killed by Google. Nowadays AI agents also don't read ads. Let's see how that is going, but the ad industry isn't amused about that.

eugeneonai 5mo ago

Agree on RSS as the right shape — and worth adding the cost angle nobody's quantified here yet. Having an LLM read a 50KB HTML page is ~$0.03 of gpt-4o input. Polling 1000 sources hourly = ~$720/day, almost all of it tokenizing layout chrome the model throws away. RSS-shaped feeds drop that 90%+ because they strip to deltas. The harder blocker is the supply side though — publishers earn pennies per human pageview from ads and ~$0 from agent polls, so unless feeds become licensed paid endpoints, the publisher incentive runs against your "publish an RSS feed for your content" recommendation. Just like that :)

ramaseshanms 5mo ago

Indeed, the simplicity and structure behind RSS perfectly fits agentic AI. Web 4.0 (or Web 5.0) would definitely use a protocol whose principles might be similar to RSS.