> Aside from the IP issues, it’s absolutely going to be used by bad actors: models fine-tuned on images of exes, co-workers, and, of course, popular targets of

> Aside from the IP issues, it’s absolutely going to be used by bad actors: models fine-tuned on images of exes, co-workers, and, of course, popular targets of online harassment campaigns. Combining those with any of the emerging NSFW models trained on large corpuses of porn is a disturbing inevitability. I'm wondering when the destruction of the traditional internet and trust networks, ala Neal Stephenson's "Fall, or, Dodge in Hell" is brought about. In the book (spoilers I suppose), an engineer develops a set of tools to cheaply and easily generate an internet hoax, the example the engineer uses to demonstrate the technology being a fake nuking of a town in if I remember correctly Ohio. Through sockpuppeting and a few choice hiring of actors (and just a teensy bit of image and video manipulation), he's able to convince the world for about a day that the USA has lost a remote town to a nuclear strike, and in fact it remains a conspiracy for decades after whether the town actually was nuked or not. The point that I'm thinking about now though is the engineer develops these tools a bit further, then, after (with consent) targeting them wholesale on a single person, releases them to the world, which basically completely destroys the modern internet as misinformation and information become perfectly interchangeable. A lot of reviews leave out how important this plot point was for the development of the various technologies that feed the main plot of the novel, that being an mind-upload scifi, namely technology around anonymous distributed ledger identification based on traits only AI can accurately tie to a person (i imagined it as like, millions of subtle characteristics such as how someone used their mouse, the pauses between typing certain characters, etc). Long story short it become impossible to trust anything viewed directly on the internet without extensive editor (in the publication sense of the word) support.