5 ms·
The summary of a spam message is "this is a spam message", not "you've gotten the inheritance of a Nigerian prince". We're being told that AIs are basically as
by kalleboo 2y ago
The summary of a spam message is "this is a spam message", not "you've gotten the inheritance of a Nigerian prince".
We're being told that AIs are basically as smart as humans, that AGI is arriving this year and all our jobs are on the line. The average human assistant would not get this assignment wrong.
- scarface_74 2y agoEven worse, we have done a good job of detecting spam before AI was a thing.
- matthewdgreen 2y agoFrom my perspective it doesn't matter if AIs are smarter than human assistants. The problem here is that AI summarization is predictable. Spammers will run the summarization tooling on their own AI-generated messages until they find candidates that don't get recognized as spam. No matter how smart the AI is, they'll eventually beat it. I'm sure the results are going to be super fascinating.
- cuteboy19 2y agoApple intelligence summarization is certainly not predictable. it can do some really funny things
- matthewdgreen 2y agoMost of these systems are randomized, but given sufficient oracle access to the APIs you should be able to detect which messages are likely to get summarized as non-spam.
- cuteboy19 2y agoits not about randomness per-message. rather it can summarize a given message in a very weird non intuitive way. the summarization itself can be bad
- rafram 2y agoThe on-device model that Apple is using for this isn’t billed as “basically as smart as humans,” to be fair. It’s likely just a small text summarization model, not a foundation model like GPT-*.
- kalleboo 2y agoI think the marketing is deliberately vague. The feature is called "intelligence" but it's literally not intelligent.
- Crosseye_Jack 2y agoYou’re reading the marketing copy wrong! It’s clearly as intelligent as an Apple, at least on par with a Granny Smith!
- lilyball 2y agoIt's not the job of a summary model to identify spam. The summary model runs after junk filtering, so everything that is given to the summary model is, by definition, already classified as "not spam". A summary model that decides the thing it's supposed to be summarizing is spam is a broken summary model.
- alt227 2y agoIf a summary model cannot summarise spam as 'spam' then its not a very good summary model.
- lxgr 2y agoWhat’s spam to me is a good deal or important information to somebody else. This is a text summarization model, not a personal assistant.
- ffsm8 2y agoWhile that's technically true for theoretical other cases, I sincerely doubt anyone could argue that this applies to this particular example. Is your argument that it cannot determine obvious spam - because there are people thatd classify some authentic emails as spam?
- lxgr 2y agoIf something can be obviously determined as spam, it shouldn't make it through the spam filter, which runs way before this model. If the spam detection model can't, e.g. because doing so would require more context on the user and more capabilities, I don't think a summarization model would be able to help, and you'd need something more like a "personal assistant" model. That said, I don't think we are too far away from that, but this particular model is not that.
- lxgr 2y agoThat’s not a summary, that’s an interpretation/editorialization.
- kalleboo 2y agoEvery summary is an interpretation/editorialization. That's what happens when you have to pick out what is important or not. A poor summary of a text picks out and presents the unimportant bits.
- lxgr 2y agoYes, but there are degrees/layers to this, and having different words for each makes sense. At a very very high level, a spell checker and an editor advising on your target audience's aesthetic preferences and cultural nuances are the same thing; at the level we're talking about here the distinction becomes important. Imagine asking an editor how to spell "xenomorph" and their feedback is to tell you to rewrite your story in a fantasy setting instead.
- LocalH 2y ago> We're being told that AIs are basically as smart as humans, that AGI is arriving this year and all our jobs are on the line. Two of those are lies writ large, and I hope that most here understand which two.
- rsynnott 2y ago> We're being told that AIs are basically as smart as humans, that AGI is arriving this year and all our jobs are on the line. I mean, not by anyone worth listening to, tho.
- johann8384 2y agoThe average human assistant would absolutely get this wrong. I've been absolutely amazed at how vulnerable the average human is. One example, a city manager sent $150k via wire transfer to a foreign account because a phishing email told them to. 1) The city didn't typically pay things by wire transfer 2) The amount was much more than would normally be handled by this person's role alone 3) The process for paying something required an invoice and approvals, an email should never have been enough to trigger this response.
- jrflowers 2y ago>The average human assistant would absolutely get this wrong “The average human falls for scam texts” is a funny thing to make up in pursuit of defending software that falls for scam texts. Scammers send out these texts by the thousands because the average human does not fall for scam texts. Most people are average, which would mean most people that you know have fallen for scam texts if your position were true. Is it true in your social circle that most people you know have fallen for scam texts and given the scammers money?
- Elizabeth0147 2y ago[dead]