3 ms·

Tangentially on this note, if anyone is interested, I can produce a list of every RSS feed known to the marginalia search crawler. It's a pretty noisy list, bu

Tangentially on this note, if anyone is interested, I can produce a list of every RSS feed known to the marginalia search crawler. It's a pretty noisy list, but any thing I can do to help the spread, discovery and adoption of RSS I'm happy to help with so just let me know. I a tool in place to export this data to help power the experimental RSS preview feature[1], but haven't had the inspiration to do much with that yet. [1] e.g. https://search.marginalia.nu/site/jvns.ca https://search.marginalia.nu/site/jvns.ca --edit-- Ok so there was interest. Give me a moment, I'll need to run an extraction script. Check back in a few hours or bookmark https://downloads.marginalia.nu/exports/ https://downloads.marginalia.nu/exports/

djoldman 3y ago
I think the community would be interested in list and you'd get a lot of downloads if you offered it up.
petercooper 3y ago
I would be very keen to have access to that list and to, ideally, have a go at cleaning it up and producing a topical subset for broader use in certain fields I'm interested in (e.g. all the "developer blogs", say). I offer an OPML file of several hundred engineering/dev related blogs at https://engineeringblogs.xyz/ https://engineeringblogs.xyz/ but I'm starting to think a little bigger.
lowercasename 3y ago
That would be _so_ cool! What an amazing resource that would be.
hactually 3y ago
I started a submission based platform ( bao.social but not currently resolving) as a side project because I missed the accessibility for RSS. would be keen on the list or even just connecting with you and OP
- marginalia_nu 3y ago
  Feel free to shoot me an email if you want to have a chat, bounce ideas or whatever. That goes for other people as well ;-) I'm a bit busy with finalizing my grant-funded work in the immediate future so reply times may be a bit slow, but such is life.
yakkomajuri 3y ago
I'd be keen on this and would import all of them into Recess (https://app.recessfeed.com https://app.recessfeed.com) - also working on RSS adoption and discovery!
deleted 3y ago
[deleted]
mariusor 3y ago
Isn't there a way to integrate this type of info into the actual search engine? Ie, search for type:rss or atom and return the links to the RSS feeds? [edit] I mean, to have it closer to what OP showed.
- 8organicbits 3y ago
  I know the Google search console lets you upload a site map, which can be an RSS feed, so the information is readily available. I suspect Google isn't incentivised to promote RSS, especially after they killed Google Reader.
marginalia_nu 3y ago
Alright, about half a million RSS feeds available at: https://downloads.marginalia.nu/exports/ https://downloads.marginalia.nu/exports/ [select feeds.csv] The data is, as mentioned, pretty noisy. It's a best-effort guess as to which is the canonical RSS feed for the particular domain. There doesn't appear to be any convention for specifying this, so when there's multiple a fair bit of guesswork is involved. Expect a fair number of dead URLs, lots of spam from CRMs that generate uninteresting feeds.

djoldman 3y ago

I think the community would be interested in list and you'd get a lot of downloads if you offered it up.

petercooper 3y ago

I would be very keen to have access to that list and to, ideally, have a go at cleaning it up and producing a topical subset for broader use in certain fields I'm interested in (e.g. all the "developer blogs", say). I offer an OPML file of several hundred engineering/dev related blogs at https://engineeringblogs.xyz/ https://engineeringblogs.xyz/ but I'm starting to think a little bigger.

lowercasename 3y ago

That would be _so_ cool! What an amazing resource that would be.

hactually 3y ago

I started a submission based platform ( bao.social but not currently resolving) as a side project because I missed the accessibility for RSS. would be keen on the list or even just connecting with you and OP

marginalia_nu 3y ago
Feel free to shoot me an email if you want to have a chat, bounce ideas or whatever. That goes for other people as well ;-) I'm a bit busy with finalizing my grant-funded work in the immediate future so reply times may be a bit slow, but such is life.

yakkomajuri 3y ago

I'd be keen on this and would import all of them into Recess (https://app.recessfeed.com https://app.recessfeed.com) - also working on RSS adoption and discovery!

deleted 3y ago

[deleted]

mariusor 3y ago

Isn't there a way to integrate this type of info into the actual search engine? Ie, search for type:rss or atom and return the links to the RSS feeds? [edit] I mean, to have it closer to what OP showed.

8organicbits 3y ago
I know the Google search console lets you upload a site map, which can be an RSS feed, so the information is readily available. I suspect Google isn't incentivised to promote RSS, especially after they killed Google Reader.

marginalia_nu 3y ago

Alright, about half a million RSS feeds available at: https://downloads.marginalia.nu/exports/ https://downloads.marginalia.nu/exports/ [select feeds.csv] The data is, as mentioned, pretty noisy. It's a best-effort guess as to which is the canonical RSS feed for the particular domain. There doesn't appear to be any convention for specifying this, so when there's multiple a fair bit of guesswork is involved. Expect a fair number of dead URLs, lots of spam from CRMs that generate uninteresting feeds.