3 ms·
I've learned that getting a good data set is often the most challenging part of data analysis. You think "it should be easy to get this data" and usually it's n
by TheCowboy 9y ago
I've learned that getting a good data set is often the most challenging part of data analysis. You think "it should be easy to get this data" and usually it's not, unless someone else has already done the work.
One flaw I can already identify with your data set is that it doesn't differentiate between traffic originating from workplaces, or cellphone traffic. A source like Netflix could be a heavily biased set since it relies on self-selected subscribers; there is no skipping research about if their user base provides an adequate sample at the county level. Asking a huge company like Google and getting them to pay attention is another challenge.
The article writes about how the FCC does have more granular data, but "the commission is wary of “one carrier learning about another carrier’s market share or where their customers are,” Rosenberg said." So you are at the mercy of competitive businesses willingly releasing data that competitors might find useful.