3 ms·
It's worth noting that most statistical packages include the ability to generate a five-number summary (https://en.m.wikipedia.org/wiki/Five-number_summary http
by minimaxir 10y ago
It's worth noting that most statistical packages include the ability to generate a five-number summary (https://en.m.wikipedia.org/wiki/Five-number_summary https://en.m.wikipedia.org/wiki/Five-number_summary), which generates many of the described skew-independent descriptive statistics automatically. (R, for example, will generate a five-number summary for each feature of a data frame with a simple summary(df) )
The TL;DR is to just plot everything if possible to visualize skew explicitly (or tricks like the Quartet), and there are a number of tools which can do that without much LOC overhead. (e.g ggplot2)
- jfaucett 10y agoyou can also use the aptly named fivenum() func in R :)
- apathy 10y agosummary(df) will do that for every column of a dataframe with less code... which is why few people use fivenum() The majority of defaults in R exist because statisticians do these things all the time and don't like typing any more than programmers. Time spent typing could be spent thinking about what assumptions are being violated and whether the results offer any useful insight.
- knowtheory 10y agoYeah, this is a narrative challenge in reporting. Often skewedness of a data set is a(n important) piece of background context, and figuring out how to get that detail into a story without being like AND HERE IS A BIG CHART WHICH YOU WILL NEED HELP INTERPRETING is non-trivial.
- eanzenberg 10y agoPandas has a .describe() function on dataframes too.