2 ms·

It’s certainly hard to detect authorship per se, but I expect very easy to detect content people produce using LLMs. You can target affiliate marketing blogs an

It’s certainly hard to detect authorship per se, but I expect very easy to detect content people produce using LLMs. You can target affiliate marketing blogs and other SEO garbage, entirely ignoring whether it’s literally written by human hands.

A_D_E_P_T 3y ago
> It’s certainly hard to detect authorship per se, but I expect very easy to detect content people produce using LLMs. Yes. For now. Just flag the use of the words "delve" and "deep dive," flag bullet-pointed paragraphs and lists, and flag anything that closes with a too-neat one-paragraph conclusion — and you've just caught 85% of AIspam. But this is already changing, and in about 6-10 months I expect it'll be impossible to detect at more than 70% confidence whether an article is written by an AI or a human. (You could say: The human writes with soul, with style, whereas the AI is totally bland, irritatingly didactic, and generic. But you can quite easily coax an AI into imitating any literary style, and some of the best AI-generated content is warped in this way.)
- tacocataco 3y ago
  > Yes. For now. Just flag the use of the words "delve" and "deep dive," flag bullet-pointed paragraphs and lists, and flag anything that closes with a too-neat one-paragraph conclusion Uhoh, is my copy pasta in danger of being snuffed out before anyone is served it? Look, I get how some people would consider it spam. However, the problem still remains and the solution has not changed! I have a life to live and can't spend every waking moment crafting a unique comment every time I need to reply to someone.
mvkel 3y ago
This is the Netflix algorithm problem. They had an algorithm that perfectly recommended content to you. Then they scrapped it and went back to star ratings. Why? Netflix makes money from monthly subscriptions. They lose money when actually streaming content to users. So the ideal user from their standpoint is one who keeps paying but watches almost nothing. Thus, the company is incentivized to put out just enough good stuff so you won't cancel, but they don't want you binging. If Google sends users to pages and advertisers pay them, the incentive to address the content problem isn't there. In fact, LLM content may be another cash cow waiting in the wings.
- baq 3y ago
  You're right, they never used the winning algorithm, possible for reasons you describe. The prize was a recruitment tool from the start, though. I don't think they ever intended to use any result.

A_D_E_P_T 3y ago

> It’s certainly hard to detect authorship per se, but I expect very easy to detect content people produce using LLMs. Yes. For now. Just flag the use of the words "delve" and "deep dive," flag bullet-pointed paragraphs and lists, and flag anything that closes with a too-neat one-paragraph conclusion — and you've just caught 85% of AIspam. But this is already changing, and in about 6-10 months I expect it'll be impossible to detect at more than 70% confidence whether an article is written by an AI or a human. (You could say: The human writes with soul, with style, whereas the AI is totally bland, irritatingly didactic, and generic. But you can quite easily coax an AI into imitating any literary style, and some of the best AI-generated content is warped in this way.)

tacocataco 3y ago
> Yes. For now. Just flag the use of the words "delve" and "deep dive," flag bullet-pointed paragraphs and lists, and flag anything that closes with a too-neat one-paragraph conclusion Uhoh, is my copy pasta in danger of being snuffed out before anyone is served it? Look, I get how some people would consider it spam. However, the problem still remains and the solution has not changed! I have a life to live and can't spend every waking moment crafting a unique comment every time I need to reply to someone.

mvkel 3y ago

This is the Netflix algorithm problem. They had an algorithm that perfectly recommended content to you. Then they scrapped it and went back to star ratings. Why? Netflix makes money from monthly subscriptions. They lose money when actually streaming content to users. So the ideal user from their standpoint is one who keeps paying but watches almost nothing. Thus, the company is incentivized to put out just enough good stuff so you won't cancel, but they don't want you binging. If Google sends users to pages and advertisers pay them, the incentive to address the content problem isn't there. In fact, LLM content may be another cash cow waiting in the wings.

baq 3y ago
You're right, they never used the winning algorithm, possible for reasons you describe. The prize was a recruitment tool from the start, though. I don't think they ever intended to use any result.