9 ms·
Grow the IndieWeb with Webmentions
- toomim 6y agoDo you get any spam webmentions? Do you do anything to prevent spam?
- superkuh 6y agoIf you implement webmention spec then the URL and page that mention you have to have a link on the page back to the post they are mentioning. This filters out a lot of spam. There's a more complicated anti-spam system that isn't fully implemented yet. I personally run a catch-all for POSTs on my webmention endpoint so I can do pingback and arbitrary stuff with it too. In terms of spam, yeah, old trackback/pingback spammers are still doing their thing. I get a dozen or so a day. It's easy to filter most out by looking for any triplicate or greater POSTs but that requires doing batch processing. Overall I think webmention would fall to spam if it became popular but right now it's a wonderful time. This applies to all systems open enough to be useful. It's the natural lifecycle.
- rascul 6y ago> There's a more complicated anti-spam system that isn't fully implemented yet. You may be thinking of Vouch. https://indieweb.org/Vouch https://indieweb.org/Vouch
- gobengo 6y agoSome talk of Spam and 'OcapPub' by Serge at https://archive.org/details/apconf-talks https://archive.org/details/apconf-talks
- JoshuaMulliken 6y agoThis seems like a recipe for spam and crap to end up hosted on my domain.
- wiml 6y agoFor those like me who are out of the loop: * Webmentions are like pingbacks, but use a simple POST instead of an XMLRPC call; * They're not particularly new (2013ish); * Webmention.io is a service to make it easier to participate in webmentions without operating your own POST endpoint.
- danellis 6y agoIs this web rings again?
- giantrobot 6y agoPingbacks. Same spam potential but POSTs rather than XML-RPC.
- gobengo 6y agoI think it's a reasonable approach to consider spam as an authorization issue, and authorization was left to extensions, but generally it could involve oauth2/oidc + dynamic client registration + any policy of allowlisting webmention senders
- bwclk 6y agoBecoming a "citizen of the IndieWeb"† seems to require you to be a web developer. Level 1 requires knowledge of HTML, or a CMS that exposes the rel attribute on links (is that common?). Level 2 requires specific CSS classes and... more than I can summarize succinctly here. And there's still Level 3 to go. It's hard to see this growing beyond web developers unless it's baked into other software as an incidental. † https://indiewebify.me https://indiewebify.me - linked in the article as "a quick start to becoming a citizen of the IndieWeb"
- rascul 6y agoThere is a list [0] which may be informative. Known [1] implements a number of IndieWeb things, and there are Wordpress plugins. [2] [0] https://indieweb.org/projects https://indieweb.org/projects [1] https://withknown.com/ https://withknown.com/ [2] https://indieweb.org/WordPress/Plugins https://indieweb.org/WordPress/Plugins
- bwclk 6y agoThose don't really steer it out of web developer territory though, do they? Known's an SSG, and unless WordPress has grown a lot I doubt it's a complete solution (not theme dependant, etc). That meta chat room is something. Is that how you came to this thread? It's strange to see dismissive comments in there but no outreach to the sources of them. Feels very cliquey.
- rascul 6y ago> Known's an SSG Is SSG a static site generator? I'm pretty sure Known is a SQL database backed dynamic kind of thing. I looked at it several years ago and I don't remember it being static. > unless WordPress has grown a lot I doubt it's a complete solution (not theme dependant, etc) I know very little about WordPress. I do know there are IndieWeb plugins for it. To what extent WordPress might be a solution for you, I wouldn't have any idea. > That meta chat room is something. Is that how you came to this thread? I wasn't in the chat room. IndieWeb is something that I've had some interest in and I generally look at posts here about IndieWeb related stuff when they show up from time to time.
- luord 6y agoLast weekend I decided to remove all third party services/javascript from my website, replacing them with external links (for the share button or the contact form), nothing (for google analytics[1]) or with web mentions (for disqus). Not sure how viable it is since it was actually more work than I thought it'd be, but at least I feel better now about my site not loading external stuff and setting unnecessary cookies. Now I guess I should actually write more stuff to see if I get mentions (and to test how vulnerable to spam it is, I suppose). I haven't ruled out looking into other ways to implement federated comment systems—or similar, like web mentions—though[2]. [1]: That said, I'm using cloudflare so I guess I do get its analytics. [2]: And there's always the self-hosted option.
- kstrauser 6y agoI set up a Matomo server and use it for my own analytics. I like the information it gives, and love that no one but me has access to any of the data.
- southerntofu 6y ago> remove all third party services/javascript from my website Congratulations on that! I personally believe it should be the foundation for any website, but well... > how vulnerable to spam it is, I suppose This depends on how you implement it. You may implement simple rate-limiting/quotas, manual verification, or go the fancy way and implement signatures and/or vetting (not widely implemented yet in the ecosystem). > I'm using cloudflare Please consider not doing that. It's even worse than having 3rd party JS on your website. At least with 3rd party JS, i can disable JS in my browser or use an adblocker. When you use Cloudflare, you ask a private company to strip & search every person who'd like to access your website, and many persons are stuck in the process. Cloudflare does have an option to let users from Tor access your website. But if you don't tick it, the default setting will leave all privacy-sensitive people at your doorstep, with a bad experience of your site. If JS is enabled, the CAPTCHA will loop forever driving us insane. If JS is disabled, the CAPTCHA won't even load. Cloudflare is one of the worst things that can happen to Internet freedom, by centralizing all communications (especially as part of a free tier that encourages many non-profits to move over) and terminating TLS connections on there. If you enjoy free-software, privacy and computing ethics, please never use any Cloudflare product or equivalent. If you have problems with DDOS, many hosting providers have very good solutions that do not infringe on your or your readers' privacy.
- bastawhiz 6y agoThis sounds a lot like pingbacks, which have been around for decades. https://en.m.wikipedia.org/wiki/Pingback https://en.m.wikipedia.org/wiki/Pingback
- gobengo 6y agoYes when we were standardizing Webmentions we all knew that. Personally, because I got started coding in 2005 around the time they became popular for blogs (https://www.hixie.ch/specs/pingback/pingback https://www.hixie.ch/specs/pingback/pingback), but 'pingback' isn't always well defined (by one nonprofit org's IP), it involves XML-RPC (while form-urlencoded works fine and is simpler for limited scope), and the W3C Social WG charter read as somewhat instructive to prefer JSON or form-urlencoded encodings to XML. https://www.w3.org/2013/socialweb/social-wg-charter https://www.w3.org/2013/socialweb/social-wg-charter Somewhat similar story with how 'WebSub sure looks a lot like PubSubHubBub' https://www.w3.org/TR/websub/ https://www.w3.org/TR/websub/ https://pubsubhubbub.github.io/PubSubHubbub/pubsubhubbub-core-0.4.html https://pubsubhubbub.github.io/PubSubHubbub/pubsubhubbub-cor... Or how "ActivityPub targeting and delivery sure looks like Linked Data Notifications" https://www.w3.org/TR/activitypub/#h-note-9 https://www.w3.org/TR/activitypub/#h-note-9 https://www.w3.org/TR/ldn/ https://www.w3.org/TR/ldn/
- tyingq 6y agoI wonder if it scrapes the page to support <link rel="canonical"> so that duplicate content gets the webmentions. Urg. Nevermind...found the repo, and it appears to. https://github.com/remy/wm/search?q=canonical https://github.com/remy/wm/search?q=canonical
- mjgs 6y agoI like the idea of aggregating mentions from around the web on my personal static site. Ideally I would want to always have the most recent data, and not expose my site in a way that could be hacked. These are the implementations that come to mind: - re-render entire site on receipt of new mention (live data, but dangerous) - re-render site on a schedule (less dangerous, nearly live data) - fetch mentions client-side (live data, safe, but requires javascript enabled in the browser) [UPDATED] - use cloud edge worker to insert the live data as the page is being returned to client (live data, safe, works with JS disabled in browser) Are there some implementations that I’m missing?
- 90minuteAPI 6y agoLive-but-throttled is a decent compromise between the first two. Maybe something that submits a notification directly to you, as chance to approve/deny/respond, moderate what gets published, and be generally aware of what you’re publishing for that matter.
- mjgs 6y agoOh yeah I hadn’t considered the need for a review & approve step. That’s pretty important. So actually implementing web mentions is kind of non-trivial.
- mjgs 6y agoAn option that just occurred to me: - use edge workers to fetch and insert data as the page is being returned to the client That would work in browsers with JS disabled. You could also have client-side code to update with live data as it comes in. The downside is that it’s not very portable code, but that’s the same for most serverless stuff, and it’s probably not that difficult to re-implement on another platform.
- southerntofu 6y ago> not expose my site in a way that could be hacked What do you mean? XSS? SQL injection? What are you afraid would get hacked? > use cloud edge worker So you let a 3rd party private company interfere in serving your website? Of course we rely on third parties for some things, but that's a pretty dramatic course of action to let one of those edit your webpages on the fly.
- nunodonato 6y agoThis is cool! I'll be looking into adding webmentions to Kalaksi.com my rss-based social network. It makes perfect sense and is very much aligned with the "open web" I'm trying to help survive.
- southerntofu 6y agoThat's super cool, please post the link on HN and other link aggregators when you do :)
- nunodonato 6y agoI did. Unfortunately, it didnt catch up :(
- southerntofu 6y agoi followed link from your account and i don't understand, where's the source code? i really love the whole concept of news aggregation and reoutputting a new RSS feed so other users can subscribe to your feed(s) is great! how would you say it compares to hubzilla? (apart from not supporting many other protocols)
- nunodonato 6y agoit isn't opensourced... at least not yet. Hubzilla is different. Kalaksi is still centralized, but the content is fully open and readable from anywhere (via RSS). So you can publish/curate, and your readers dont necessarily need to use kalaksi to access it.
- southerntofu 6y agoOh, that's really sad. If i may, why would you consider developing software that's not free software? Also, why would you develop software to provide services for other users, that they can't selfhost if/when you're not longer hosting the service? That sounds like serious footguns/antipatterns to me, so i'm curious what's your rationale :)
- tarkin2 6y agoThe only third party js I have is disqus. Is this a good alternative? I guess it doesn’t allow comments unless you mention it from your site?
- southerntofu 6y ago> I guess it doesn’t allow comments unless you mention it from your site? That is the principle yes. However with or without webmention, you can build a public commenting system on your website. All it takes is form-processing on a server-side endpoint (to receive comments and filter out spam) and retrieving/formatting comments either on the server site (querying the endpoint whether per-request for dynamic sites, or as part of your build pipeline for static sites). Webmention is a technology that enables websites to federate using semantic HTML. Comments are an order of magnitude simpler and never ever required any JavaScript or third party service. I never understood why people use Disqus, and i certainly will never enable JavaScript to comment on a website.
- Vinnl 6y agoThis page describes receiving WebMentions. If you're looking at sending them, a while back I implemented that in a small npm library as part of a grant. In case it's useful to anyone: https://www.npmjs.com/package/webmen https://www.npmjs.com/package/webmen
- southerntofu 6y agoIn case people are wondering, it's as simple as parsing your own HTML pages for links, fetching those links, parsing the remote HTML for a webmention endpoint, and if this exists, send a request over to it with headers indicating the URL of your own page, and the URL you linked to. The nature of the interaction is not contained within the webmention, but rather the site on the other site will fetch and parse your page to figure that out. That information is within the HTML itself, such as `<a class="u-in-reply-to" href="foo.bar/baz">Commenting on this article</a>` to express a commenting/reply relationship.
- Vinnl 6y agoYep, thanks for the addition!
- mro_name 6y agothe issue with 'web'mentions is that they're in fact htmlmentions or even better microformatmentions. Duh. They insist on microformats which are no use for any content other than html, in my case atom: https://demo.mro.name/shaarligo https://demo.mro.name/shaarligo Plz prove me wrong.
- estaseuropano 6y agoCould someone explain what the difference between a webmentipn and the ancient pingback/trackback concept is? It seems just a difference in presentation?