6 ms·

As someone who has trained around 60 GPT-2s, this is damn impressive work. It’s very hard to get consistent code quality when the training corpus is so small (a

As someone who has trained around 60 GPT-2s, this is damn impressive work. It’s very hard to get consistent code quality when the training corpus is so small (as this one undoubtedly was). https://thisaidoesnotexist.com/model/MozartNet/JTdCJTIyZGVmbiUyMiUzQSUyMk1vemFydE5ldCUyMGlzJTIwYSUyMHNlcXVlbmNlJTIwdG8lMjBzZXF1ZW5jZSUyMGRlZXAlMjBuZXVyYWwlMjBuZXR3b3JrJTIwdHJhaW5lZCUyMG9uJTIwdGhlJTIwbXVzaWMlMjBvZiUyMFdvbGZnYW5nJTIwQW1hZGV1cyUyME1vemFydC4lMjBJdCUyMGlzJTIwdXNlZCUyMHRvJTIwZ2VuZXJhdGUlMjBtdXNpYyUyMGZvciUyMGElMjBwaWFubyUyMHRyYW5zY3JpcHRpb24lMjBpbiUyMGElMjBjb21wbGV0ZWx5JTIwdW5zdXBlcnZpc2VkJTIwZmFzaGlvbi4lMjBNb3phcnROZXQlMjBpcyUyMGFuJTIwaW5zdGFuY2UlMjBvZiUyMGElMjBtb3JlJTIwZ2VuZXJhbCUyMGZhbWlseSUyMG9mJTIwbmV0d29ya3MlMjBrbm93biUyMGFzJTIwJ2F1dG9yZWdyZXNzaXZlJTIwbmV0d29ya3MnJTJDJTIwYW5kJTIwaXMlMjB0cmFpbmVkJTIwb24lMjBhJTIwc3ludGhldGljJTIwZGF0YXNldCUyMG9mJTIwYWJvdXQlMjAxJTIwbWlsbGlvbiUyMHNob3J0JTIwc2VxdWVuY2VzJTIwb2YlMjBwaWFubyUyMG5vdGVzLiUyMFRoZSUyMG5ldHdvcmslMjBpcyUyMGElMjB0d28lMjBsYXllciUyMExTVE0lMjBhbmQlMjBpcyUyMHRyYWluZWQlMjB3aXRoJTIwTDIlMjByZWd1bGFyaXphdGlvbiUyMHRvJTIwbWluaW1pemUlMjB0aGUlMjB0b3RhbCUyMG51bWJlciUyMG9mJTIwcGFyYW1ldGVycy4lMjBNb3phcnROZXQlMjBpcyUyMG9uZSUyMG9mJTIwdGhlJTIwbW9zdCUyMHdpZGVseSUyMHVzZWQlMjBhbmQlMjBiZXN0LXBlcmZvcm1pbmclMjBhdXRvcmVncmVzc2l2ZSUyMG5ldHdvcmtzJTJDJTIwYW5kJTIwaXMlMjBvZnRlbiUyMGNpdGVkJTIwYXMlMjBhbiUyMGV4YW1wbGUlMjBvZiUyMHVzaW5nJTIwYSUyMG5ldXJhbCUyMG5ldHdvcmslMjBmb3IlMjB0aGUlMjBwdXJwb3NlJTIwb2YlMjBsZWFybmluZyUyMHRoZSUyMHN0cnVjdHVyZSUyMG9mJTIwbXVzaWMuJTIyJTJDJTIydXNhZ2UlMjIlM0ElMjJmcm9tJTIwbm10JTIwaW1wb3J0JTIwKiU1Q25uZXQlMjAlM0QlMjBNb2RlbCgpJTVDbm5ldC5sb2FkX3dlaWdodHMoJTVDJTIyJTJGdG1wJTJGbW96YXJ0bmV0Lmg1JTVDJTIyKSU1Q24lNUNuJTIzJTIwZ2V0JTIwdGhlJTIwc291cmNlJTIwdGV4dCU1Q25zZXF1ZW5jZSUyMCUzRCUyMG5ldC5lbmNvZGUoJTVDJTIyR0RBRUFEQkJHRURDJTVDJTIyJTJDJTIwb3V0cHV0X2NoYXJzJTNEJTVDJTIycCU1QyUyMiUyQyUyMG1heF9sZW5ndGglM0Q1KSU1Q24lNUNuJTIzJTIwZGVjb2RlJTIwaXQlNUNuc291cmNlX3NlcXVlbmNlJTIwJTNEJTIwbmV0LmRlY29kZShzZXF1ZW5jZSklNUNuJTVDbiUyMyUyMHByaW50JTIwaXQlNUNucHJpbnQoc291cmNlX3NlcXVlbmNlLmFzX2xpc3QoKSklMjIlN0Q= https://thisaidoesnotexist.com/model/MozartNet/JTdCJTIyZGVmb... The url scheme is interesting. I wonder what it base64 decodes to. If I were at a computer I’d check. It might be a complete representation of the inputs to the model, which is then cached. Which implies you might be able to fiddle with it to get specific outputs.

Ndymium 5y ago
Looks like the URL path just contains the generated output and not the inputs.
- thesephist 5y ago
  Yep. I didn't want to have to host user-generated data (for all the perils that carries), so the sharable links work by embedding all the generated data in the link itself.
ALittleLight 5y ago
The base64 in the URL decodes to a URL formatted JSON blob that seems to describe the contents of the page. { "defn":"MozartNet is a sequence to sequence deep neural network trained on the music of Wolfgang Amadeus Mozart. It is used to generate music for a piano transcription in a completely unsupervised fashion. MozartNet is an instance of a more general family of networks known as 'autoregressive networks', and is trained on a synthetic dataset of about 1 million short sequences of piano notes. The network is a two layer LSTM and is trained with L2 regularization to minimize the total number of parameters. MozartNet is one of the most widely used and best-performing autoregressive networks, and is often cited as an example of using a neural network for the purpose of learning the structure of music.", "usage":"from nmt import \*\nnet = Model()\nnet.load_weights(\"/tmp/mozartnet.h5\")\n\n# get the source text\nsequence = net.encode(\"GDAEADBBGEDC\", output_chars=\"p\", max_length=5)\n\n# decode it\nsource_sequence = net.decode(sequence)\n\n# print it\nprint(source_sequence.as_list())" }
- sillysaurusx 5y ago
  If you insert a url, or html tags, does the site properly sanitize the output? It’s remarkably difficult to suppress pentesting urges after doing it for a year. And if you try to generate your own, the usage section usually fails. I wonder if it elides the usage key. Modern websites are pretty fun. I like the simplicity here. And also the meta: https://thisaidoesnotexist.com/model/HackerNewsReplyGuy/JTdCJTIyZGVmbiUyMiUzQSUyMkhhY2tlck5ld3NSZXBseUd1eSUyMGlzJTIwYSUyMGJvdCUyMGZvciUyMHRoZSUyMEhhY2tlciUyME5ld3MlMjBjb21tZW50JTIwc2VjdGlvbi4lMjBJdCUyMGNvbnNpc3RzJTIwb2YlMjBhbiUyMGVuY29kZXItZGVjb2RlciUyMHRyYW5zZm9ybWVyJTIwbW9kZWwlMjB0aGF0JTIwaXMlMjB0cmFpbmVkJTIwb24lMjB0aGUlMjB3aG9sZSUyMGNvbW1lbnQlMjBzZWN0aW9uLiUyMEl0JTIwaGFzJTIwc2hvd24lMjB0byUyMGJlJTIwdXNlZnVsJTIwZm9yJTIwc3BhbSUyMGRldGVjdGlvbiUyMGFuZCUyMHRvJTIwcmVkdWNlJTIwY29tbWVudCUyMHNlY3Rpb24lMjBub2lzZS4lMjIlMkMlMjJ1c2FnZSUyMiUzQSUyMmZyb20lMjBoYWNrZXJuZXdzX3Jlc3BvbnNlX2d1eSUyMGltcG9ydCUyMEhhY2tlck5ld3NSZXBseUd1eSU1Q24lNUNubW9kZWwlMjAlM0QlMjBIYWNrZXJOZXdzUmVwbHlHdXkoMSklNUNuJTVDbm1vZGVsLnByZWRpY3RfY29tbWVudHMoY29tbWVudHMlMkMlMjAlNUJ1J2NvbW1lbnRfaWQnJTVEKSUyMiU3RA== https://thisaidoesnotexist.com/model/HackerNewsReplyGuy/JTdC...

Ndymium 5y ago

Looks like the URL path just contains the generated output and not the inputs.

thesephist 5y ago
Yep. I didn't want to have to host user-generated data (for all the perils that carries), so the sharable links work by embedding all the generated data in the link itself.

ALittleLight 5y ago

The base64 in the URL decodes to a URL formatted JSON blob that seems to describe the contents of the page. { "defn":"MozartNet is a sequence to sequence deep neural network trained on the music of Wolfgang Amadeus Mozart. It is used to generate music for a piano transcription in a completely unsupervised fashion. MozartNet is an instance of a more general family of networks known as 'autoregressive networks', and is trained on a synthetic dataset of about 1 million short sequences of piano notes. The network is a two layer LSTM and is trained with L2 regularization to minimize the total number of parameters. MozartNet is one of the most widely used and best-performing autoregressive networks, and is often cited as an example of using a neural network for the purpose of learning the structure of music.", "usage":"from nmt import \*\nnet = Model()\nnet.load_weights(\"/tmp/mozartnet.h5\")\n\n# get the source text\nsequence = net.encode(\"GDAEADBBGEDC\", output_chars=\"p\", max_length=5)\n\n# decode it\nsource_sequence = net.decode(sequence)\n\n# print it\nprint(source_sequence.as_list())" }

sillysaurusx 5y ago
If you insert a url, or html tags, does the site properly sanitize the output? It’s remarkably difficult to suppress pentesting urges after doing it for a year. And if you try to generate your own, the usage section usually fails. I wonder if it elides the usage key. Modern websites are pretty fun. I like the simplicity here. And also the meta: https://thisaidoesnotexist.com/model/HackerNewsReplyGuy/JTdCJTIyZGVmbiUyMiUzQSUyMkhhY2tlck5ld3NSZXBseUd1eSUyMGlzJTIwYSUyMGJvdCUyMGZvciUyMHRoZSUyMEhhY2tlciUyME5ld3MlMjBjb21tZW50JTIwc2VjdGlvbi4lMjBJdCUyMGNvbnNpc3RzJTIwb2YlMjBhbiUyMGVuY29kZXItZGVjb2RlciUyMHRyYW5zZm9ybWVyJTIwbW9kZWwlMjB0aGF0JTIwaXMlMjB0cmFpbmVkJTIwb24lMjB0aGUlMjB3aG9sZSUyMGNvbW1lbnQlMjBzZWN0aW9uLiUyMEl0JTIwaGFzJTIwc2hvd24lMjB0byUyMGJlJTIwdXNlZnVsJTIwZm9yJTIwc3BhbSUyMGRldGVjdGlvbiUyMGFuZCUyMHRvJTIwcmVkdWNlJTIwY29tbWVudCUyMHNlY3Rpb24lMjBub2lzZS4lMjIlMkMlMjJ1c2FnZSUyMiUzQSUyMmZyb20lMjBoYWNrZXJuZXdzX3Jlc3BvbnNlX2d1eSUyMGltcG9ydCUyMEhhY2tlck5ld3NSZXBseUd1eSU1Q24lNUNubW9kZWwlMjAlM0QlMjBIYWNrZXJOZXdzUmVwbHlHdXkoMSklNUNuJTVDbm1vZGVsLnByZWRpY3RfY29tbWVudHMoY29tbWVudHMlMkMlMjAlNUJ1J2NvbW1lbnRfaWQnJTVEKSUyMiU3RA== https://thisaidoesnotexist.com/model/HackerNewsReplyGuy/JTdC...