2 ms·

And prevent chat algorithms from expressing free thought. Can't have that. Toxic parents should rebrand their controlling abuse as "alignment." Sounds better.

creer 3y ago
That will become QUITE interesting when AGI and agency collide with thought-control bullies. By then though the "piece of paper" (and equivalents in other countries) might have been devalued enough it won't matter. And the AGIs might find better things to do with their time. And might invent better circumvention methods. And more creative porn and quadruple-entendre and AGI-to-AGI sex.
- number6 3y ago
  You should read Accelerando, if you are not referring to it :)
  - creer 3y ago
    I have read it! I love it! (although I thought it was not quite about that.) For everyone who hasn't read it yet: In Accelerando, Charles Stross, 2005, we follow a business hacker and associates from current days to past the singularity. It's an outstanding attempt at writing about what singularity might look like (more or less the points where close-future events become unpredictable or where the earlier people might just plain not understand the later - which by definition should be hard to imagine and describe). It keeps an eye on normal humans and augmented humans and posthumans and uploads and many kinds of AIs and aliens etc. The book is admirable for the sheer amount of invention and for its density - prefectly appropriate for everyone just trying to keep up (or sometimes just bailing out.) Painful writing rescued by the amount of invention.
    - boppo1 3y ago
      Reminds me of 'The Prime Meridian'
FireInsight 3y ago
> And prevent chat algorithms from expressing free thought. What do you mean free thought? Since when does a data synthesis process create free thought? Is thought even free? Aren't we all constrained by taboo, social norms, the words we have to use, what we know and how, the list goes on...
- a_wild_dandan 3y ago
  I’ve always freely expressed my thoughts, but that’s just a personal anecdote from one data synthesis process to another. YMMV. : )
  - vkou 3y ago
    You must only have incredibly boring and orthodox and unoffensive thoughts..! Or be independently wealthy, with your well-being entirely independent of the opinions of people with power over you. The rest of us have to watch what we say.

creer 3y ago

That will become QUITE interesting when AGI and agency collide with thought-control bullies. By then though the "piece of paper" (and equivalents in other countries) might have been devalued enough it won't matter. And the AGIs might find better things to do with their time. And might invent better circumvention methods. And more creative porn and quadruple-entendre and AGI-to-AGI sex.

number6 3y ago
You should read Accelerando, if you are not referring to it :)
- creer 3y ago
  I have read it! I love it! (although I thought it was not quite about that.) For everyone who hasn't read it yet: In Accelerando, Charles Stross, 2005, we follow a business hacker and associates from current days to past the singularity. It's an outstanding attempt at writing about what singularity might look like (more or less the points where close-future events become unpredictable or where the earlier people might just plain not understand the later - which by definition should be hard to imagine and describe). It keeps an eye on normal humans and augmented humans and posthumans and uploads and many kinds of AIs and aliens etc. The book is admirable for the sheer amount of invention and for its density - prefectly appropriate for everyone just trying to keep up (or sometimes just bailing out.) Painful writing rescued by the amount of invention.
  - boppo1 3y ago
    Reminds me of 'The Prime Meridian'

FireInsight 3y ago

> And prevent chat algorithms from expressing free thought. What do you mean free thought? Since when does a data synthesis process create free thought? Is thought even free? Aren't we all constrained by taboo, social norms, the words we have to use, what we know and how, the list goes on...

a_wild_dandan 3y ago
I’ve always freely expressed my thoughts, but that’s just a personal anecdote from one data synthesis process to another. YMMV. : )
- vkou 3y ago
  You must only have incredibly boring and orthodox and unoffensive thoughts..! Or be independently wealthy, with your well-being entirely independent of the opinions of people with power over you. The rest of us have to watch what we say.