4 ms·
> Is there a reason the same techniques used in E-Mail aren't applicable to Twitter? Twitter relies on very low latency - ie, once you tweet something, if it a
by chimeracoder 13y ago
> Is there a reason the same techniques used in E-Mail aren't applicable to Twitter?
Twitter relies on very low latency - ie, once you tweet something, if it a whole minute to appear in your friends' timelines, it could already have lost much of its value.
Lots of spam reduction techniques introduce latency to levels that are unacceptable to Twitter's use case.
I'm not sure why it didn't catch these, but I can imagine why the same techniques aren't applicable in general.
- orf 13y agoSure, but couldn't they run something that cleans up already posted tweets? That wouldn't introduce any latency while posting but would still (eventually) get rid of them automatically and hopefully pretty fast.
- elwell 13y agoI think they are. Most of the search results I'm seeing are only up until a minute ago.
- mntmn 13y agoThey do – they deleted a tweet from my timeline.
- CWuestefeld 13y agoIf my twitter account was compromised and used to send spam, I think the way I'd discover this is by seeing the record of tweets sent by the false "me". If those are being culled, then how will I know that my account has been compromised?
- fastest963 13y agoYou can do pretty aggressive spam detection in way less than 100ms. Source: I wrote a system that can do it in less than 10ms at Grooveshark.
- rubyrescue 13y agoany way i could pick your brain for 20 mins? we're dealing with a lot of it at whisper... would buy beers or ... whatever you want.
- fastest963 13y agoShoot me an email james@grooveshark.com. Love to chat!
- mkjones 13y agohey I work on anti-spam at FB. Happy to talk sometime. facebook.com/mkjones or @fisherrider on twitter (lol). You can learn a little about how we think about securing login here: http://vimeo.com/80460475 http://vimeo.com/80460475.
- rubyrescue 13y agothx, will reach out!
- stevekemp 13y agoI've never timed it, but I do try to do realtime-spam detection on blog/forum comments: http://blogspam.net/ http://blogspam.net/ Although it operates at a much smaller scale than most of the things linked to here it does work pretty well.
- thrownaway2424 13y agoI doubt if that's even true, because Twitter's tail latency on API calls is in the hundreds of seconds. They do not operate a low-latency service (and they don't operate a high volume service either, by my standards). I think the real problem is not latency, but simply they don't have the signals needed to differentiate spam from not.
- scg 13y agoWhere did you get the latency data from?
- comex 13y agoSpeaking as a user, when someone sends me a reply, I expect to see it in seconds via the streaming API so I can have a short IM-style conversation, and I consider this a nice benefit to using Twitter (rather than, say, email), if not totally essential. Hundreds of seconds sounds bad, but if that were the norm, it would be a serious problem.