10 ms·
Evolution of words frequencies in porn
- ozh 13y agoQuite fun! Next: provide the porn industry a simple markov chain script to generate probabilistic porn movie titles, and save them all those incredibly tiresome brainstrom sessions they must have to create new titles :)
- onnoonno 13y agoI think the interesting part about all this is how it changes over time. I have this impression that the whole area of sex is still and always has been a weird reflection on society at large. I would be curious, for example, for a much longer term graph comparing frequency of the two words 'hardcore', and 'love'.
- mazr 13y agohttps://books.google.com/ngrams/graph?content=hardcore%2Clove&year_start=1800&year_end=2013&corpus=15&smoothing=3&share=&direct_url=t1%3B%2Chardcore%3B%2Cc0%3B.t1%3B%2Clove%3B%2Cc0 https://books.google.com/ngrams/graph?content=hardcore%2Clov... Not the same dataset though...
- Negitivefrags 13y agoThis reminds me of the first time I implemented a markov chain text generator. We were at a LAN party so we looked on the public network shares to find a corpus of text files to use as input. The first thing we found was a copy of the bible and the second thing we found was someones collection of porn stories. The start of the output was "He slipped his tongue into the lord..."
- deleted 13y ago[deleted]
- jpswade 13y agohttp://porngram.sexualitics.org/?q=cup http://porngram.sexualitics.org/?q=cup
- stcredzero 13y agowords frequency Is the title a British thing? Like maths vs. math?
- polymatter 13y agoAs a native Brit, looks like a mistake to me.
- toyg 13y agoProbably just an error: the guys behind it are French http://sexualitics.org/#theteam http://sexualitics.org/#theteam
- route66 13y agoTo speak of evolution when your time frame is 2008-2012 is somewhat far fetched. But I believe I see a reassuring trend here: http://porngram.sexualitics.org/?q=erlang%2C+clojure%2C+Ada%2C+scala%2C+rust http://porngram.sexualitics.org/?q=erlang%2C+clojure%2C+Ada%...
- donquichotte 13y agoClearly, golang is getting traction. http://porngram.sexualitics.org/?q=erlang%2Cclojure%2CAda%2Cscala%2Crust%2Cgo http://porngram.sexualitics.org/?q=erlang%2Cclojure%2CAda%2C...
- ushi 13y agoOmg, look at C. It outperforms everything... http://porngram.sexualitics.org/?q=erlang%2Cclojure%2CAda%2Cscala%2Crust%2Cgo%2Cc http://porngram.sexualitics.org/?q=erlang%2Cclojure%2CAda%2C...
- IgorPartola 13y agoAs someone pointed out below, this just looks at substrings so looking for "C" means looking for any words that has the letter "C" in it.
- tunnuz 13y agoThis comment made my day :D
- mappum 13y agoI would be terrified if "brainfuck" had a nonzero frequency.
- deleted 13y ago[deleted]
- vanderZwan 13y agoAnd yet, somehow very surprised.
- endriju 13y agohttp://porngram.sexualitics.org/?q=btc%2Cusd http://porngram.sexualitics.org/?q=btc%2Cusd
- uloweb 13y agohttp://porngram.sexualitics.org/?q=iphone%2Candroid http://porngram.sexualitics.org/?q=iphone%2Candroid
- viraptor 13y agoI find the graph shapes amusing given the data source :)
- easy_rider 13y agoIn my first 2 weeks of working at an adult company (as a dev yes, it's sad) one of my tasks was to watch/scan 200+ video's and describe them.. It's true, you run out of inspiration fast. Also I could hint you: the "love" in the titles is probably explained by "love(s) to <insert profanity> ". I don't think I ever used hardcore in a title.
- mratzloff 13y agoI used to work with a guy who once worked as a dev at an adult company. He said it was the most soul-sucking experience of his career, and that the owners knew absolutely nothing about technology and treated their tech staff terribly. Based on the fact that you had to spend your first two weeks doing data entry, it sounds like his experience wasn't unique.
- easy_rider 13y agoI didn't quite learn if this was an industry thing. Never met other devs in the industry from other companies. He painted a perfect picture. Just talking about it makes me unhappy :)
- mapleoin 13y agohttp://porngram.sexualitics.org/?q=hipster http://porngram.sexualitics.org/?q=hipster
- duiker101 13y agoI wonder how we survived before 2009 without hipster porn.
- deleted 13y ago[deleted]
- himal 13y agohttp://porngram.sexualitics.org/?q=HIV%2CAIDS http://porngram.sexualitics.org/?q=HIV%2CAIDS
- edoloughlin 13y agoStrange: http://porngram.sexualitics.org/?q=tea,wine,beer,coffee http://porngram.sexualitics.org/?q=tea,wine,beer,coffee
- RyanMcGreal 13y agoIn a similar vein: http://porngram.sexualitics.org/?q=breakfast%2Clunch%2Cdinner%2Csnack http://porngram.sexualitics.org/?q=breakfast%2Clunch%2Cdinne...
- choult 13y agoNot sure that that is so strange when you consider tea might appear more often due to a fairly well-known n-grame including its delivery container...
- sushirain 13y agoIt counts sub-string frequency, not word frequency. Try "a,b,c".
- misnome 13y agoKind of interesting, but really needs statistical error bounds
- probably_wrong 13y agoTraditional professions are still on top: http://porngram.sexualitics.org/?q=pizza%2Cdelivery%2Cplumber%2C+programmer http://porngram.sexualitics.org/?q=pizza%2Cdelivery%2Cplumbe... I sense a business opportunity there.
- rmk2 13y ago> Traditional professions are still on top: Time to change positions, then!
- jeltz 13y agohttp://porngram.sexualitics.org/?q=pizza%2Cdelivery%2Cplumber%2Cprogrammer%2Cteacher%2Cwhore http://porngram.sexualitics.org/?q=pizza%2Cdelivery%2Cplumbe... Teaching and prostitution clearly dominate.
- sushirain 13y ago1. It doesn't count word frequencies, but sub-string frequencies. Moreover, if a sub-string appears more than once-per-title, then it is counted more than once. I draw this conclusion by submitting "a,b,c". And from their paper [1]: our algorithm strips out dashes and catches any occurrence of the query in the title, for example, 'blow' catches 'blowing', 'blowjobs' This explains the results of these queries: "ada,erlang", "tea,beer". As an alternative they could have used a stemmer [2]. 2. The "slow,fast" and "love,hardcore" trends illustrate an interesting trend. Perhaps towards women or mainstream viewers. [1] http://sexualitics.org/wp-content/uploads/2014/01/PORNSTUDIES_preprint.pdf http://sexualitics.org/wp-content/uploads/2014/01/PORNSTUDIE... [2] http://nlp.stanford.edu/IR-book/html/htmledition/stemming-and-lemmatization-1.html http://nlp.stanford.edu/IR-book/html/htmledition/stemming-an...
- easy_rider 13y ago> 2. The "slow,fast" and "love,hardcore" trends illustrate an interesting trend. Perhaps towards women or mainstream viewers. I don't think so [1] [1] https://www.google.nl/search?q=teen+loves+to&oq=teen+loves+to+fuck https://www.google.nl/search?q=teen+loves+to&oq=teen+loves+t...
- thinker 13y agoI wonder if we'll soon see an Upworthy for Porn: "You will never believe what this girl did to pay her rent"
- keammo1 13y ago"He was just there to fix the cable. What happened next will shock you"
- 6d0debc071 13y agoI suppose we may as well do the obvious ones http://porngram.sexualitics.org/?q=BDSM%2Ctorture%2Cpain%2Crape http://porngram.sexualitics.org/?q=BDSM%2Ctorture%2Cpain%2Cr... :/
- catFishery 13y agoI dunno, the less obvious ones are more interesting. http://porngram.sexualitics.org/?q=twat%2Ccunt%2Cfist%2Cprolapse%2Cscrote%2Cbeast%2Cschlong http://porngram.sexualitics.org/?q=twat%2Ccunt%2Cfist%2Cprol...
- guybrushT 13y agoVery interesting to see the dataset being made available. Whenever I want to do this kind of analysis, I always stumble at 'how to get the data?'. In their paper, it is mentioned that "We created a dedicated computer program to carry out the navigation and data collection tasks required to gather the metadata for all available videos...". I would love to see this program. More broadly, can anyone help me with best resources (pref python) where one can learn to crawl/scrape this type of information?
- mazr 13y agoHi, I didn't release the code of the crawler, first, because it was not well-crafted enough to be released (quick and dirty linear programming), and second, because any change in the site you crawl calls for recrafting your code. I used python, sometimes with Beautifulsoup, sometimes with lxml, both are very good for crawling. I would say BS is easier, and LXML cleaner.
- deleted 13y ago[deleted]
- bobowzki 13y ago"sister" :-)
- graylights 13y agoSo I did gay vs lesbian and I was confused why there was a big spike in 2010 for gay that has since dropped off. Is this an anomaly in their sampling? Also Obama's numbers have really dropped compared to Bush: http://porngram.sexualitics.org/?q=bush%2Cobama http://porngram.sexualitics.org/?q=bush%2Cobama