5 ms·

Aside from Copilot, does anyone know of any other products that are making use of GPT-3? The hype was huge when it was released, and the early beta testers wer

Aside from Copilot, does anyone know of any other products that are making use of GPT-3? The hype was huge when it was released, and the early beta testers were showing some amazing (and cherry picked) demos, most famously the ability to write working React code. But since then, I've not seen much...

manishsharan 5y ago
I have a feeling it is being used to produce more nonsensical web pages. Often when I am searching the web for information on a product or a review , I land on a page that has weirdly phrased and often repetitive sentences which provide no useful information. I am assuming those pages are generated by OpenAI or similar technology.
- miohtama 5y ago
  Had similar experience recently and it had made all the way to be the top Google news hit - apparently the site is cranking out ”news” as SEO spam to promote their app. https://mobile.twitter.com/moo9000/status/1458733299346591747 https://mobile.twitter.com/moo9000/status/145873329934659174...
- ccheney 5y ago
  I recall in the mid/late 2000's implementing a markov text generator to create thousands of static html pages based on certain keywords. This has been a problem for over a decade and will probably get worse as text generation tools improve, e.g. GPT-3.
- ju_sh 5y ago
  I've got some insight into this (Several friends, now multi-millionaires ran and flipped tens of sites like this) They're mostly written by low paid content writers in 3rd world countries such as Vietnam and the Philippines. Primarily to drive affiliate traffic to Amazon and other retailers with affiliate schemes. They all operate on a similar format - 10 items with good reviews, write 300 words about each product, rinse, repeat, profit.
  - eggsmediumrare 5y ago
    What a world where people can become multi-millionaires in this way while nurses and teachers can't even get cost of living adjustments.
- missinfo 5y ago
  I often wonder about this with Twitter accounts. How many are already GPT-3 generated? We'll need another GPT-3 bot to detect the GPT-3 bots.
- bransonf 5y ago
  Bingo It’s increasingly difficult to find product reviews with search engines. Massive auto generated content farms take a product name and add loads of AI-generated filler text. Pop in a bunch of banner ads and an affiliate link and they have huge economic incentive to scale these operations. I’m very pessimistic about the direction the internet is going these days. The AI crisis isn’t going to be sentient AI trying to kill us, it’s going to be a flood of noise over knowledge.
  - Jorge1o1 5y ago
    Until we have to start making AIs to identify knowledge and filter out noise. And then a whole cat-and-mouse game between fake news AI and fake news detection AI.
    - visarga 5y ago
      The end result is more robust AI and an understanding of failure modes.
    - tehsauce 5y ago
      This is the exact situation we are currently in. https://rowanzellers.com/grover/ https://rowanzellers.com/grover/
  - skybrian 5y ago
    Sometimes it works to add "reddit" to your search to find interesting comments. I suppose that will eventually be gamed too.
- penjelly 5y ago
  been playing with copilot lately and even it just seems more annoying then it is helpful so far. Will continue experimenting but so far my impression has soured a bit
  - visarga 5y ago
    I tried Copilot and removed it from my IDE. Not good enough, only fills in obvious parts and even there makes mistakes.
- jakear 5y ago
  The singularity will come when the set of training data available for scrape is dominated by AI generated content and the AI's learnings are derivatives of what old AI's produced. Human thought on the other hand has some sort of undefinable entropic-value that AI to-date is missing, a Human can produce a "good idea", whereas an AI produces a bunch of potential continuations of a stings of text and selects randomly amongst them (or, even better, a Human selects from them). Unfortunately the advertising game mixes up the incentives and flips the equation so that the purpose of communication isn't to share a "good idea" as efficiently as possible, but rather to keep eyeballs on your website for as long as possible in the hope some flashy banner ad will distract your user and you'll get your $0.02 for them abandoning your page, likely unfinished. AI will (and already does) excel at this sort of task, but it's the kind of task that ought to have no value whatsoever. Luckily we have increasingly sophisticated summarization-AI to go from the filler-AI generated crap back down to a couple of bullet points, but at that point you've invested millions of dollars, researcher-hours, engineer-hours, compute-hours, etc, to make the worst text-compression utility of all time.
  - visarga 5y ago
    By the way, it's not just text anymore, you can train GPT-3 on Youtube. You get aligned visual and speech channels and data in vast quantities. That means it's easier to tell if the source is human.
- occamrazor 5y ago
  Right now most of those pages are produced by much simpler models, which copy an existing page and replace text snippets with synonyms. I am sure that soon the spammers will switch to better models.
arnvald 5y ago
Copy.ai uses GPT3 under the hood. Not a product for devs, but still a growing business
- rpeden 5y ago
  There are quite a few similar products that used the OpenAI API as well.
sailingparrot 5y ago
Not GPT-3, because it's too big, but much smaller models of similar architecture are used for smartcompose in Word/Outlook GMail/Docs and other places.
zzbzq 5y ago
The terms and conditions prevent you from making anything good with it. All of my ideas were banned because they're too unethical or just recapitulate the functionality of the sandbox. Some key partners like Microsoft have a separate agreement where they're allowed to make useful things.
- Filligree 5y ago
  You might want to peek at NovelAI.net instead. It's the exact opposite, in just about every possible way. Including, I'm afraid, model generality -- it's tuned for fiction, and nothing else, but it's very good at that.
deleted 5y ago
[deleted]
- deleted 5y ago
  [deleted]
jstx1 5y ago
There are subreddits with model-generated porn stories. All the horny people writing for each other are getting automated. In the example I saw some people had sex and then took their clothes off at the end. It's groundbreaking stuff.
- gigglesupstairs 5y ago
  Okay this is legit the funniest thing I read today on Internet
- andybak 5y ago
  > In the example I saw some people had sex and then took their clothes off at the end. I mean - that is technically feasible.
- harpersealtako 5y ago
  That was literally what like 90% of AI Dungeon (GPT-3-based CYOA adventure simulator) players were using it for. Then OpenAI forced AI Dungeon to implement strict content filters, and within a month the community had already stood up a fully functional replacement fine-tuned on literotica with 10 times the features and a focus on privacy and zero content restrictions. The community replacement was partially bankrolled by the sale of AI-generated anime catgirl image NFTs. That's barely scratching the surface of the AI-generated erotica scene, it's pretty wild.
  - Filligree 5y ago
    NovelAI, I presume? Funnily enough, so long as you aren't trying for porn it does a much better job than AI Dungeon did of staying away from it. It lives up to its name — it's an excellent cowriter for all forms of fiction.
    - harpersealtako 5y ago
      Yup, that's the one. And I agree, it's really good for general use, and if you know how to use the tools right it's arguably better than AI dungeon.
keerthiko 5y ago
I integrated copilot with VSCode (it's pretty easy to get off the waitlist I believe) and have been using it to unblock me from my ADHD when I'm writing code. Basically as I think through a bugfix in our app's codebase, I navigate to the line where I believe "the fix should go here", and a few characters in, copilot is filling up the lines. 80% of the time it is non-compilable, but nearly 50% of the time it's close to the fix I was going to put in. It's then just a matter of me fixing much simpler errors and bugs in the copilot-suggested LOC. I have found that I get far less distracted from writing bugfixes once I start looking at the code. I'm not going to let copilot push commits to PROD anytime soon, but it's like having a really smart intern who doesn't really know exactly what I'm trying to solve but has a decent idea, pair programming with me. So it's not like these AI tools will replace me yet, but they are certainly living up to the goal of "copilot".
- eggsmediumrare 5y ago
  People are afraid of being replaced when what we actually should be afraid of is be de-valued.
keewee7 5y ago
There are plenty of services in the "automate writing ads and blog spam" space. Not making the world better in any way.
deleted 5y ago
[deleted]
jacob_rezi 5y ago
We've managed to integrated it well into our software for resumes with positive user feedback https://www.youtube.com/watch?v=qxk9S2CRsAE&ab_channel=Rezi https://www.youtube.com/watch?v=qxk9S2CRsAE&ab_channel=Rezi

manishsharan 5y ago

I have a feeling it is being used to produce more nonsensical web pages. Often when I am searching the web for information on a product or a review , I land on a page that has weirdly phrased and often repetitive sentences which provide no useful information. I am assuming those pages are generated by OpenAI or similar technology.

miohtama 5y ago
Had similar experience recently and it had made all the way to be the top Google news hit - apparently the site is cranking out ”news” as SEO spam to promote their app. https://mobile.twitter.com/moo9000/status/1458733299346591747 https://mobile.twitter.com/moo9000/status/145873329934659174...
ccheney 5y ago
I recall in the mid/late 2000's implementing a markov text generator to create thousands of static html pages based on certain keywords. This has been a problem for over a decade and will probably get worse as text generation tools improve, e.g. GPT-3.
ju_sh 5y ago
I've got some insight into this (Several friends, now multi-millionaires ran and flipped tens of sites like this) They're mostly written by low paid content writers in 3rd world countries such as Vietnam and the Philippines. Primarily to drive affiliate traffic to Amazon and other retailers with affiliate schemes. They all operate on a similar format - 10 items with good reviews, write 300 words about each product, rinse, repeat, profit.
- eggsmediumrare 5y ago
  What a world where people can become multi-millionaires in this way while nurses and teachers can't even get cost of living adjustments.
missinfo 5y ago
I often wonder about this with Twitter accounts. How many are already GPT-3 generated? We'll need another GPT-3 bot to detect the GPT-3 bots.
bransonf 5y ago
Bingo It’s increasingly difficult to find product reviews with search engines. Massive auto generated content farms take a product name and add loads of AI-generated filler text. Pop in a bunch of banner ads and an affiliate link and they have huge economic incentive to scale these operations. I’m very pessimistic about the direction the internet is going these days. The AI crisis isn’t going to be sentient AI trying to kill us, it’s going to be a flood of noise over knowledge.
- Jorge1o1 5y ago
  Until we have to start making AIs to identify knowledge and filter out noise. And then a whole cat-and-mouse game between fake news AI and fake news detection AI.
  - visarga 5y ago
    The end result is more robust AI and an understanding of failure modes.
  - tehsauce 5y ago
    This is the exact situation we are currently in. https://rowanzellers.com/grover/ https://rowanzellers.com/grover/
- skybrian 5y ago
  Sometimes it works to add "reddit" to your search to find interesting comments. I suppose that will eventually be gamed too.
penjelly 5y ago
been playing with copilot lately and even it just seems more annoying then it is helpful so far. Will continue experimenting but so far my impression has soured a bit
- visarga 5y ago
  I tried Copilot and removed it from my IDE. Not good enough, only fills in obvious parts and even there makes mistakes.
jakear 5y ago
The singularity will come when the set of training data available for scrape is dominated by AI generated content and the AI's learnings are derivatives of what old AI's produced. Human thought on the other hand has some sort of undefinable entropic-value that AI to-date is missing, a Human can produce a "good idea", whereas an AI produces a bunch of potential continuations of a stings of text and selects randomly amongst them (or, even better, a Human selects from them). Unfortunately the advertising game mixes up the incentives and flips the equation so that the purpose of communication isn't to share a "good idea" as efficiently as possible, but rather to keep eyeballs on your website for as long as possible in the hope some flashy banner ad will distract your user and you'll get your $0.02 for them abandoning your page, likely unfinished. AI will (and already does) excel at this sort of task, but it's the kind of task that ought to have no value whatsoever. Luckily we have increasingly sophisticated summarization-AI to go from the filler-AI generated crap back down to a couple of bullet points, but at that point you've invested millions of dollars, researcher-hours, engineer-hours, compute-hours, etc, to make the worst text-compression utility of all time.
- visarga 5y ago
  By the way, it's not just text anymore, you can train GPT-3 on Youtube. You get aligned visual and speech channels and data in vast quantities. That means it's easier to tell if the source is human.
occamrazor 5y ago
Right now most of those pages are produced by much simpler models, which copy an existing page and replace text snippets with synonyms. I am sure that soon the spammers will switch to better models.

arnvald 5y ago

Copy.ai uses GPT3 under the hood. Not a product for devs, but still a growing business

rpeden 5y ago
There are quite a few similar products that used the OpenAI API as well.

sailingparrot 5y ago

Not GPT-3, because it's too big, but much smaller models of similar architecture are used for smartcompose in Word/Outlook GMail/Docs and other places.

zzbzq 5y ago

The terms and conditions prevent you from making anything good with it. All of my ideas were banned because they're too unethical or just recapitulate the functionality of the sandbox. Some key partners like Microsoft have a separate agreement where they're allowed to make useful things.

Filligree 5y ago
You might want to peek at NovelAI.net instead. It's the exact opposite, in just about every possible way. Including, I'm afraid, model generality -- it's tuned for fiction, and nothing else, but it's very good at that.

deleted 5y ago

[deleted]

deleted 5y ago
[deleted]

jstx1 5y ago

There are subreddits with model-generated porn stories. All the horny people writing for each other are getting automated. In the example I saw some people had sex and then took their clothes off at the end. It's groundbreaking stuff.

gigglesupstairs 5y ago
Okay this is legit the funniest thing I read today on Internet
andybak 5y ago
> In the example I saw some people had sex and then took their clothes off at the end. I mean - that is technically feasible.
harpersealtako 5y ago
That was literally what like 90% of AI Dungeon (GPT-3-based CYOA adventure simulator) players were using it for. Then OpenAI forced AI Dungeon to implement strict content filters, and within a month the community had already stood up a fully functional replacement fine-tuned on literotica with 10 times the features and a focus on privacy and zero content restrictions. The community replacement was partially bankrolled by the sale of AI-generated anime catgirl image NFTs. That's barely scratching the surface of the AI-generated erotica scene, it's pretty wild.
- Filligree 5y ago
  NovelAI, I presume? Funnily enough, so long as you aren't trying for porn it does a much better job than AI Dungeon did of staying away from it. It lives up to its name — it's an excellent cowriter for all forms of fiction.
  - harpersealtako 5y ago
    Yup, that's the one. And I agree, it's really good for general use, and if you know how to use the tools right it's arguably better than AI dungeon.

keerthiko 5y ago

I integrated copilot with VSCode (it's pretty easy to get off the waitlist I believe) and have been using it to unblock me from my ADHD when I'm writing code. Basically as I think through a bugfix in our app's codebase, I navigate to the line where I believe "the fix should go here", and a few characters in, copilot is filling up the lines. 80% of the time it is non-compilable, but nearly 50% of the time it's close to the fix I was going to put in. It's then just a matter of me fixing much simpler errors and bugs in the copilot-suggested LOC. I have found that I get far less distracted from writing bugfixes once I start looking at the code. I'm not going to let copilot push commits to PROD anytime soon, but it's like having a really smart intern who doesn't really know exactly what I'm trying to solve but has a decent idea, pair programming with me. So it's not like these AI tools will replace me yet, but they are certainly living up to the goal of "copilot".

eggsmediumrare 5y ago
People are afraid of being replaced when what we actually should be afraid of is be de-valued.

keewee7 5y ago

There are plenty of services in the "automate writing ads and blog spam" space. Not making the world better in any way.

deleted 5y ago

[deleted]

jacob_rezi 5y ago

We've managed to integrated it well into our software for resumes with positive user feedback https://www.youtube.com/watch?v=qxk9S2CRsAE&ab_channel=Rezi https://www.youtube.com/watch?v=qxk9S2CRsAE&ab_channel=Rezi