3 ms·

"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news

"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ https://talktotransformer.com/ Pretty awesome.

3pt14159 7y ago
For the lazy: <human>The bridge wasn't quite right. There were small sparks coming off the incomplete sections of material hanging just to the right of the traffic lights. Gary wasn't worried, however. He walked up carefully.</human><computer> "This is it, guys!" A huge explosion rocked the bridge, and a fireball engulfed the entire bridge. "Shit! Shit!" It seemed as though the fire was just blowing out, and the bridges were back in place. Gary was a little concerned, but it wasn't a problem at the time. At least it was under control. He walked forward, peering over the top. "This is terrible. I'm not leaving the village tonight! How about a break for some water and a drink?" When he looked down, the large chunk he had just taken off of the bridge was gone. As soon as he realized it was gone, he turned back to the village to check to see what had happened. Not sure what to do, he continued down the hill, heading toward the village at all times. The entire town was completely surrounded, and everyone was either inside or had</computer> Not bad, but it's strange that it autogenerated text with multiple spaces at the end of sentences. Also, it is far more dramatic than I would have guessed.
- noobiemcfoob 7y ago
  It's not just "not bad." It's scary. It makes enough coherent sense from sentence to sentence that I doubt my mom (missing a few marbles) would notice it doesn't make a whole lot of sense. Combine this...some official looking logos and a request for money for a fine. Determining an actual official government or other institutional request is going to get much harder.
  - sean2 7y ago
    I don't see the danger here though; how is this scarier than what a couple guys in Nigeria could concoct to fool your mom? Any English speaker can still put together a much more coherent an official sounding institutional request.
hint23 7y ago
You can also look at http://textsynth.org http://textsynth.org .
ReDeiPirati 7y ago
2 researchers from the Brown university were able to reproduce the full, and never released GPT-2 model a couple of days ago. They wrote an amazing blog post and released the weights!! Here's the blog with all the details: https://medium.com/@vanya_cohen/opengpt-2-we-replicated-gpt-2-because-you-can-too-45e34e6d36dc https://medium.com/@vanya_cohen/opengpt-2-we-replicated-gpt-... For those of you who don't know what GPT-2 is, here's the simplest & fastest way with a bit of humor: https://blog.floydhub.com/gpt2/ https://blog.floydhub.com/gpt2/
- p1esk 7y ago
  They spent $500k doing it (in research credits for compute). Not sure if this is the best way to spend so much money, considering they made no novel contribution to NLP field, and OpenAI would have most likely released it soon anyway.
julien_c 7y ago
Also https://transformer.huggingface.co https://transformer.huggingface.co Disclaimer: built it.
- p1esk 7y ago
  What was most challenging about building it?
deleted 7y ago
[deleted]

3pt14159 7y ago

For the lazy: <human>The bridge wasn't quite right. There were small sparks coming off the incomplete sections of material hanging just to the right of the traffic lights. Gary wasn't worried, however. He walked up carefully.</human><computer> "This is it, guys!" A huge explosion rocked the bridge, and a fireball engulfed the entire bridge. "Shit! Shit!" It seemed as though the fire was just blowing out, and the bridges were back in place. Gary was a little concerned, but it wasn't a problem at the time. At least it was under control. He walked forward, peering over the top. "This is terrible. I'm not leaving the village tonight! How about a break for some water and a drink?" When he looked down, the large chunk he had just taken off of the bridge was gone. As soon as he realized it was gone, he turned back to the village to check to see what had happened. Not sure what to do, he continued down the hill, heading toward the village at all times. The entire town was completely surrounded, and everyone was either inside or had</computer> Not bad, but it's strange that it autogenerated text with multiple spaces at the end of sentences. Also, it is far more dramatic than I would have guessed.

noobiemcfoob 7y ago
It's not just "not bad." It's scary. It makes enough coherent sense from sentence to sentence that I doubt my mom (missing a few marbles) would notice it doesn't make a whole lot of sense. Combine this...some official looking logos and a request for money for a fine. Determining an actual official government or other institutional request is going to get much harder.
- sean2 7y ago
  I don't see the danger here though; how is this scarier than what a couple guys in Nigeria could concoct to fool your mom? Any English speaker can still put together a much more coherent an official sounding institutional request.

hint23 7y ago

You can also look at http://textsynth.org http://textsynth.org .

ReDeiPirati 7y ago

2 researchers from the Brown university were able to reproduce the full, and never released GPT-2 model a couple of days ago. They wrote an amazing blog post and released the weights!! Here's the blog with all the details: https://medium.com/@vanya_cohen/opengpt-2-we-replicated-gpt-2-because-you-can-too-45e34e6d36dc https://medium.com/@vanya_cohen/opengpt-2-we-replicated-gpt-... For those of you who don't know what GPT-2 is, here's the simplest & fastest way with a bit of humor: https://blog.floydhub.com/gpt2/ https://blog.floydhub.com/gpt2/

p1esk 7y ago
They spent $500k doing it (in research credits for compute). Not sure if this is the best way to spend so much money, considering they made no novel contribution to NLP field, and OpenAI would have most likely released it soon anyway.

julien_c 7y ago

Also https://transformer.huggingface.co https://transformer.huggingface.co Disclaimer: built it.

p1esk 7y ago
What was most challenging about building it?

deleted 7y ago

[deleted]