3 ms·
Noodling at some thoughts on how technology works --- is fundamental mechanisms, not what it is --- I'd come up with a list of eight factors that seemed central
by dredmorbius 5y ago
Noodling at some thoughts on how technology works --- is fundamental mechanisms, not what it is --- I'd come up with a list of eight factors that seemed central. And then thought for a few days and came up with a ninth: hygiene.
In building any technology, what comes to dominate after a time are the unintended or unwanted consequences. This is particularly true of any networked system, in which as the network grows, various cost functions emerge and begin to overwhelm the value prospects.
I suspect that those cost functions are both relatively constant per node, but also tend to increase over time. The result is that small networks can grow quickly (the large positive per-node values dominante the costs), but as the node-count rises, marginal value decreases (see Tilly-Odlyzko's refutation of Metcalfe's law: v = nlog(n)), and* the cost functions increase both as bad actors are attracted to the system and as interactions between nominally good-faith actors become increasingly high-friction.
The consequence is that a "no-moderation" or "light-moderation" policy works really well, until it suddenly doesn't.
This has parallels to other network-based structures, most notably cities. Without sewage, or crime, or public health, or waste-removal, or pollution-control systems, cities can grow fairly rapidly, up to some maximum viable size. After that point, not only do already-extant issues become intolerable (or more specifically: unsurvivable), but new harms co-evolve with the cities themselves to emerge within them. (See Kyle Harper's The Fate of Rome for a wonderful exploration of this concept.)
For online UCG platforms, this presents as various forms of activity that directly attack trust and safety of the platform itself. Ultimately, growth of the platform is often limited by these effects.
Incidentally, a new professional organisation formed last year to address these issues specifically, the TSPA (Trust and Safety Professional Association). It's still finding its feet, though it's begun organising both a training curriculum and a library of practices and references on the issues, processes, considerations, and legal factors involved.
https://www.tspa.info/2020/06/17/new-organizations-dedicated-to-online-trust-and-safety/ https://www.tspa.info/2020/06/17/new-organizations-dedicated...