apwheele

37 ms·

1. 361.▲
   by apwheele 4y ago

   For a random python/pandas trick, I have come across web-api's that cannot be directly read into pandas using the URL (I imagine folks on here can comment better the difference in web serving tech), but you can read in the IO obje
2. 362.▲
   by apwheele 4y ago

   I will have to give these formulations a try. IMO pretty common to have asymptote like theoretical behavior in the tails with social science data, https://andrewpwheeler.com/2022/05/02/fitting-a-plateau-effe..
3. 363.▲
   by apwheele 4y ago

   While it is true that getting a traditional tenure track job is very tough in the current market, programs like the one in the article can make modest changes to better prep students for other roles. For a simple example, pretty much all of
4. 364.▲
   by apwheele 4y ago

   Yeah, and the R ecosystem has this built in (checking the examples run, not their output is correct). `R CMD check` has as one of its checks whether the examples you build in the help docs generate runtime errors. I use roxygen example help
5. 365.▲
   Data competitions to reduce racial bias in predictive algorithms(technologyreview.com)

   2 points by apwheele 4y ago|0 comments
6. 366.▲
   by apwheele 4y ago

   The way that these programs work, it is no questions asked (intended to get even criminals to turn in firearms, to prevent them from using in future crimes/suicides). So a "show ID to turn in" policy is a non-starter. Shamele
7. 367.▲
   by apwheele 4y ago

   That was part of the joke (I meant macro on the right hand side, not micro), but will concede I am not a terribly funny person. I think micro is much easier/more intuitive personally (I think you are projecting a bit saying anything in
8. 368.▲
   by apwheele 4y ago

   I think this is plausible on the margins, although it could be true that Davidson relative to peers are lower but still overall take the same test they are higher compared to 20 years ago as well (is there some term for people somewhat smar
9. 369.▲
   by apwheele 4y ago

   Utility(Sleeping In) > Utility(A in MacroEconomics)
10. 370.▲
    by apwheele 4y ago

    Also recommend Hubbard's How to Measure Anything . Background in social science & stats, so was familiar with the decision making logic before reading, but think the book is more straight forward than any other reference. (Similar
11. 371.▲
    by apwheele 4y ago

    Nice job -- I have examples using statsmodels for similar (not time series) data [1,2]. I typically use this for EDA before regression modelling, so dependencies in that scenario are not a big deal. But I might weep if someone told me no sc
12. 372.▲
    by apwheele 4y ago

    FYI for folks if you want to convert jupyter notebooks to html you can use nbconvert: jupyter nbconvert --execute example_report.ipynb --no-input --to html I have never been able to get a nice looking report in both html/PDF t
13. 373.▲
    by apwheele 4y ago

    End users even have problems interpreting probability statements in my experience (e.g. this factor increases probability of event by 10%) let alone graphs. When you get more complicated models, those probabilities are often spread out amon
14. 374.▲
    by apwheele 4y ago

    Yeah, currently I do things like "Top 5 important factors" for shapely values, but have debated on even doing that much. There is good evidence these reduced form estimates can often be misleading, https://arxiv.org&#x2
15. 375.▲
    by apwheele 4y ago

    Ditto, although for my applications they are not live (typical business processes lag by a month or more). So most of my stakeholders are happy that I just send a monthly PDF with updates. The endless tinkering is still requested with the s
16. 376.▲
    by apwheele 4y ago

    I picked up this book and enjoyed it just for the process, https://www.amazon.com/Make-Your-Own-Pixel-Art/dp/1593278861 . (Not an artist, just a programmer who has tried to make a few tiny pieces.) Uses aseprite.
17. 377.▲
    by apwheele 4y ago

    I create my own classes for this. (Essentially to do the same thing as sklearn pipelines, but I like creating my own classes just for this debugging/slowly expand functionality reason.) Something like: class mymodel(): ... def feat
18. 378.▲
    by apwheele 4y ago

    I don't see a conflict, unions would still be obligated to represent officers. It is just criminal behavior investigations would be shifted entirely to the DAs office (to prevent Joe from investigating his friend Bob). Also an FYI poli
19. 379.▲
    by apwheele 4y ago

    IMO I don't think unions are the fundamental issue -- many PDs internal affairs leave something to be desired (and police need unions for the same reason everyone else needs a union). So I think that responsibility should be entirely
20. 380.▲
    by apwheele 4y ago

    Not about randomness - but about curve fitting. It is actually very difficult to verify non-linear effects -- or maybe I should say the opposite. The statistical tools we use to identify non-linearities are prone to be very noisy, so even i
21. 381.▲
    by apwheele 4y ago

    Like most science reporting, the headline is a bit over-the-top, but the article is pretty straightforward. You need to consider here the control/counter-factual -- [time fasting + restricted calories] vs [restricted calories]. And bot
22. 382.▲
    Identifying fraudulent PPP loans through network analysis(tylerjamesjones.com)

    31 points by apwheele 5y ago|14 comments
23. 383.▲
    by apwheele 5y ago

    I've always taken part of my job as a data scientist is to articulate when data is not sufficient to meet a particular a goal (and to outline what data would be necessary). For some goals doing special data sampling and building a mode
24. 384.▲
    by apwheele 5y ago

    I struggle with this (kiddo is at the stage will be applying in a few years, so have thought about it), as it essentially relies on network effects with a large/unknown variance. (Is the MBA network comparable to OPs path?) What do peo
25. 385.▲
    by apwheele 5y ago

    As a researcher who has (and continues to) use the publicly available census data, I agree with this. IMO it makes more sense to have higher quality micro level data products that are only available in statistical data centers, https:&#x2F
26. 386.▲
    by apwheele 5y ago

    This doesn't work as a reasonable objective measure of population mental health disorders for several reasons. 1) The oversampling of the training set makes it uncalibrated when applied to the general population (to recalibrate you nee
27. 387.▲
    by apwheele 5y ago

    I wonder what the 40% who wouldn't eat food fertilized by urine think about the fact that urea is a common cow feed supplement.
28. 388.▲
    by apwheele 5y ago

    I think a more basic problem is people don't even know how to formulate meaningful probability hypothetical/counterfactuals to begin with (let alone update them). For Covid stuff pretty much all an individual should care about is:
29. 389.▲
    by apwheele 5y ago

    I prefer Gigerenzer’s idea of natural frequencies over the Venn diagrams. https://www.researchgate.net/figure/Gigerenzer-Hoffrage-Natu...
30. 390.▲
    by apwheele 5y ago

    While I really love Tufte's books, for more direct advice I recommend Albert Cairo's The Functional Art . I don't remember discussion of fonts offhand, but everything else in your list is covered. Several of the other commen