danielsf

5 ms·

31.
by danielsf 12y ago
I kept this focused on vocab so that the data viz was very straightforward and easy to digest/draw insights from. I've had many requests for album sales to be added, and I plan to as soon as possible :)
32.
by danielsf 12y ago
I only have rap data, sadly :(
33.
by danielsf 12y ago
OP: he's an associate, not a member
34.
by danielsf 12y ago
4!
35.
by danielsf 12y ago
nope. they are in there. if it's on the rap genius lyrics page, I included it.
36.
by danielsf 12y ago
the code is pretty straightforward, just chapter one of the NLTK book and a txt file. nltk.org/book
37.
by danielsf 12y ago
I only have hip hop data, sadly. I didn't expect wu-tang to be on the top since it would go across 11 different vocabs. I felt like the law of averages would basically play out.
38.
by danielsf 12y ago
OP here: many thanks!
39.
by danielsf 12y ago
op here: thanks yo!
40.
by danielsf 12y ago
OP here: the shakespeare thing is really just a hook, food for thought rather than an academic/cultural judgement. I also had several suggestions to use shakespeare's sonnets rather than plays, which I should have done. and yes, t
41.
by danielsf 12y ago
OP here: the challenge is that most artists' best work is in their earlier years. I'd rather have Jay-z's first album than last, ya know?
42.
by danielsf 12y ago
here's what this looks like. ugly as sin as useless for comparing rappers. http://www.mdaniels.com/vocab/scatter.png love your other ideas – hopefully can do them later.
43.
by danielsf 12y ago
hm. it should be up. try it again.
44.
by danielsf 12y ago
OP here. Do I really need to provide all of this to satisfy the reader's ability to grasp the basic premise of the site? this isn't a thesis or academic pursuit, just comparing some rappers for fun. I used plain NLTK token analysi
45.
by danielsf 12y ago
I never made the claim that vocab size was correlated with quality.
46.
by danielsf 12y ago
this is brilliant. OP here. We should work together.
47.
by danielsf 12y ago
since i use only rap genius data, i'm hoping the garbage all cancels out so that the rappers are still relatively in the right place.
48.
by danielsf 12y ago
I never made the claim that complexity is better/worse. I just wanted to communicate the data point, not imply 2pac>DMX.
49.
by danielsf 12y ago
I actually revised the conclusion to address this issue. Check it out on the site.
50.
by danielsf 12y ago
OP here. made up vocabulary is basically all of hip hop. look at any lyrics file and very little is "established", yaknowwhatimsayin?
51.
by danielsf 12y ago
this is an issue that i was hoping would cancelled out, given the fact that I use the same analysis for every rapper. In short, it's an exact unique word count, but it's relationally accurate.
52.
by danielsf 12y ago
OP here. vocab is non-linear: mdaniels.com/vocab/scatter.png so the average would change as your sample size grows. 35K was the threshold where things didn't get garbled (like the 100 word example that you mention). The thres
53.
by danielsf 12y ago
author here: hit me up with questions you've got.
54.
by danielsf 12y ago
author here: oh man. flattered.
55.
by danielsf 12y ago
author here: thanks!
56.
by danielsf 12y ago
author here: the data is straight from RP, so I have been working with them :)
57.
by danielsf 12y ago
author here: indeed. thanks for adding this to the thread.
58.
by danielsf 13y ago
New York, NY – Product Development Lab, http://futureof.io/ --- We're hiring for a start-up in an end-up (a large global-scale company) – an opportunity for scrappy devs, designers, and product managers to work in a fo
59.
by danielsf 13y ago
i just wanted to keep this safe for the non-hip-hop fans :) Point taken though. I'm going to kill the greyscale hover. It doesn't do anything meaningful and had no idea it changed the text.
60.
by danielsf 13y ago
What do you all think of this design? I used Medium, Exposure.so and Internet.org as inspiration.

More ›